00000001:02000400:3.0F:1788622718.471628:0:2954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788622727.045955:0:3156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788622728.009492:0:3215:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1331 MB/s 00000001:01000000:2.0:1788622728.259359:0:3215:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1627 MB/s 00000001:01000000:2.0:1788622728.508858:0:3215:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10311 MB/s 00000020:02000000:0.0F:1788622728.820439:0:3247:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gf69a9da 00000400:02000000:3.0:1788622729.224313:0:3262:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.119@tcp [8/256/0/180] 00008000:02000000:2.0:1788622732.833665:0:3412:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788622786.223545:0:5216:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788622798.682523:0:5790:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788622798.682529:0:5790:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788622798.682660:0:5790:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002af26c98 00000080:02000400:3.0:1788622798.682671:0:5790:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788622798.697846:0:5790:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788622798.697862:0:5790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788622798.697901:0:5790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000039c8c6b3) 00000020:00000080:3.0:1788622798.697923:0:5790:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788622798.740212:0:5790:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788622798.741236:0:5790:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788622798.763368:0:5790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788622798.763410:0:5790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788622798.763431:0:5790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788622798.763555:0:5790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788622798.763653:0:5790:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788622798.764238:0:5790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788622798.764247:0:5790:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788622798.764257:0:5790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d63da 00000020:01000004:3.0:1788622798.764265:0:5790:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788622798.764271:0:5790:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788622798.764276:0:5790:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002af26c98 from MGS 00000020:01000004:3.0:1788622798.764282:0:5790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788622798.764292:0:5790:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004e388fda) 00000020:00000080:3.0:1788622798.764301:0:5790:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788622798.764379:0:5790:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002af26c98 from MGS, refs=2 00080000:01000000:3.0:1788622798.764386:0:5790:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788622798.764391:0:5790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d63e8 00000100:00100000:3.0:1788622798.764569:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788622798.764898:0:5790:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788622798.764906:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788622798.765538:0:5790:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788622798.765546:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788622798.766640:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788622798.767110:0:5790:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788622798.767117:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788622798.767850:0:5790:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788622798.767859:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788622798.768267:0:5790:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788622798.768273:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788622798.769193:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622798.769198:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622798.769200:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622798.769664:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622798.769667:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622798.769669:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622798.770233:0:5790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788622798.774159:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788622799.022937:0:5790:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4276 MB/s 00000001:01000000:0.0:1788622799.273236:0:5790:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4727 MB/s 00000001:01000000:2.0:1788622799.522908:0:5790:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 519 MB/s 00000001:01000000:0.0:1788622799.777276:0:5790:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 586 MB/s 00010000:00010000:3.0:1788622799.790606:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0F:1788622799.811042:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788622799.846916:0:5790:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788622799.846939:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788622799.846942:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788622799.853701:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788622799.854044:0:5790:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788622799.854107:0:5790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788622799.854379:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788622799.854410:0:5790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788622799.854873:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788622799.855033:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788622799.855040:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788622799.868240:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788622799.868255:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788622799.872191:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788622799.872204:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788622799.878903:0:5790:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788622799.878929:0:5790:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.119@tcp' 00000020:01000004:2.0:1788622799.878930:0:5790:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788622799.878980:0:5790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.119@tcp (typ=mgc) 00000020:00000080:2.0:1788622799.879010:0:5790:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.119@tcp (000000003c1b26af) 00000020:00000080:2.0:1788622799.879026:0:5790:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788622799.879115:0:5790:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003680f99a@MGC192.168.204.119@tcp: add connection 192.168.204.119@tcp at head 00010000:00010000:2.0:1788622799.879296:0:5790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.119@tcp-0 is initialized 00000040:01000000:2.0:1788622799.879303:0:5790:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788622799.879762:0:5806:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788622799.879798:0:5790:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.119@tcp (uuid b1f47098-4bf9-4547-81bd-f9d9ba5d3857) 00000020:00000080:0.0:1788622799.879813:0:5790:0:(genops.c:1385:class_connect()) connect: client b1f47098-4bf9-4547-81bd-f9d9ba5d3857, cookie 0xef842f43731d63f6 00000100:00080000:0.0:1788622799.879824:0:5790:0:(import.c:545:import_select_connection()) MGC192.168.204.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788622799.879829:0:5790:0:(import.c:665:import_select_connection()) MGC192.168.204.119@tcp: import 000000003680f99a using connection 192.168.204.119@tcp/0@lo 00000100:00100000:0.0:1788622799.879872:0:5790:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b95ebce1 x1875506866684032/t0(0) o250->MGC192.168.204.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788622799.879891:0:5790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b1f47098-4bf9-4547-81bd-f9d9ba5d3857->MGS 00000020:01000004:0.0:1788622799.879906:0:5790:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788622799.879911:0:5790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788622799.879928:0:5790:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000025ebcb52) 00000020:00000080:0.0:1788622799.879937:0:5790:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1788622799.882863:0:5805:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788622799.882954:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b95ebce1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3277:1875506866684032:0@lo:250: 00000100:00100000:3.0:1788622799.883082:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622799.883171:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684032 00000100:00100000:3.0:1788622799.883180:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684032 00000100:00100000:3.0:1788622799.883219:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788622799.883226:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb2e758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875506866684032:12345-0@lo:250: 00010000:00080000:3.0:1788622799.883258:0:5801:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b1f47098-4bf9-4547-81bd-f9d9ba5d3857@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:3.0:1788622799.883285:0:5801:0:(genops.c:1385:class_connect()) connect: client b1f47098-4bf9-4547-81bd-f9d9ba5d3857, cookie 0xef842f43731d6404 00000100:00080000:3.0:1788622799.883443:0:5801:0:(import.c:65:import_set_state_nolock()) 0000000063f4b163 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788622799.883506:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb2e758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:3277:x1875506866684032:12345-0@lo:250: Request processed in 280us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622799.883513:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622799.883555:0:3277:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788622799.883565:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.119@tcp: connect to target with instance 0 00000100:00080000:2.0:1788622799.883576:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788622799.883581:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788622799.883585:0:3277:0:(import.c:65:import_set_state_nolock()) 000000003680f99a MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788622799.883588:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788622799.883591:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788622799.883595:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b95ebce1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3277:1875506866684032:0@lo:250: 00000100:00100000:0.0:1788622799.905726:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788622799.905998:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788622799.906005:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788622799.909238:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788622799.909250:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788622799.911578:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788622799.911592:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788622799.912687:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788622799.914676:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788622799.914685:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788622799.916123:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788622799.916132:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788622799.960204:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788622799.960442:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788622799.960449:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788622799.961543:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788622799.961565:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788622799.962430:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788622799.962718:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788622799.962724:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788622799.963199:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788622799.963206:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788622799.963866:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788622799.963996:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788622799.964000:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788622799.964391:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788622799.964397:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788622799.965131:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788622799.965280:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788622799.965285:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788622799.966351:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788622799.966360:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788622800.014304:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788622800.014563:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788622800.014570:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788622800.021859:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788622800.021883:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788622800.022679:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788622800.022689:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788622800.024366:0:5790:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788622800.024398:0:5790:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788622800.024405:0:5790:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788622800.024575:0:5790:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788622800.024617:0:5790:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.119@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788622800.024621:0:5790:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788622800.024623:0:5790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788622800.024624:0:5790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622800.024625:0:5790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622800.024626:0:5790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622800.024628:0:5790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622800.024629:0:5790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788622800.024630:0:5790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788622800.024632:0:5790:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622800.024633:0:5790:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622800.024634:0:5790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622800.024641:0:5790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788622800.024644:0:5790:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788622800.024646:0:5790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788622800.024646:0:5790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788622800.024647:0:5790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622800.024648:0:5790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622800.024649:0:5790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622800.024650:0:5790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622800.024650:0:5790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788622800.024651:0:5790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788622800.024652:0:5790:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622800.024652:0:5790:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622800.024653:0:5790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622800.024654:0:5790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788622800.024701:0:5790:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788622800.024719:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efbaf887 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684160:0@lo:253: 00000100:00100000:2.0:1788622800.027950:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622800.028011:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4abf71b going to sleep for 11 seconds 00000100:00100000:0.0:1788622800.028241:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684160 00000100:00100000:0.0:1788622800.028250:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684160 00000100:00100000:0.0:1788622800.028306:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788622800.028315:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b064633d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:5790:x1875506866684160:12345-0@lo:253: 20000000:01000000:0.0:1788622800.028377:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788622800.028380:0:5804:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788622800.028882:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788622800.028948:0:5804:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788622800.029245:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788622800.030225:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788622800.031027:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788622800.031032:0:5804:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788622800.031038:0:5804:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788622800.031041:0:5804:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788622800.031057:0:5804:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788622800.031348:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788622800.032055:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788622800.032071:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788622800.032124:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788622800.032173:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788622800.032208:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788622800.032320:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788622800.032329:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788622800.032377:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788622800.032384:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788622800.032414:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788622800.032421:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788622800.032450:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788622800.032499:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788622800.032530:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788622800.032536:0:5804:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788622800.032683:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788622800.033072:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788622800.033084:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788622800.033124:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788622800.033159:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788622800.033208:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788622800.033222:0:5804:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788622800.033314:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788622800.033323:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788622800.033377:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788622800.033413:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788622800.033448:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788622800.033461:0:5804:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788622800.033540:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788622800.035920:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788622800.036045:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788622800.036090:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788622800.036333:0:5804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788622800.036384:0:5804:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788622800.036393:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788622800.037246:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788622800.037648:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788622800.037673:0:5804:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.119@tcp for mdt 20000000:01000000:0.0:1788622800.037676:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.119@tcp (null) (null) (null) 00000040:00080000:0.0:1788622800.037713:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788622800.037721:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788622800.037905:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788622800.037914:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.119@tcp (null) (null) 00000040:00080000:0.0:1788622800.037960:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788622800.037982:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788622800.038015:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788622800.038068:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788622800.038137:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788622800.038141:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788622800.038147:0:5804:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788622800.038153:0:5804:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788622800.038681:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788622800.039083:0:5804:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788622800.053193:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788622800.053295:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788622800.053380:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788622800.053401:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788622800.053404:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788622800.053407:0:5804:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788622800.053431:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788622800.053434:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788622800.053475:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788622800.053477:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788622800.055582:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788622800.055945:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788622800.055993:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788622800.056109:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1788622800.056125:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788622800.056127:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788622800.057439:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788622800.057784:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788622800.057834:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788622800.057871:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788622800.057886:0:5804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788622800.057888:0:5804:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788622800.057896:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788622800.057918:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057935:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057946:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057952:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057958:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057964:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057969:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b132a02 already unused, calling callback (000000003e6cd363) 00010000:00010000:3.0:1788622800.057973:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.057993:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.058006:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.058013:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.058018:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b132a02/0xef842f43731d640b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788622800.058034:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788622800.457485:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b064633d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:5790:x1875506866684160:12345-0@lo:253: Request processed in 429163us (429535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622800.457505:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622800.457830:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efbaf887 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684160:0@lo:253: 10000000:01000000:2.0:1788622800.457846:0:5790:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788622800.457850:0:5790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788622800.457851:0:5790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788622800.457853:0:5790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622800.457854:0:5790:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788622800.457855:0:5790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622800.457856:0:5790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622800.457857:0:5790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788622800.457859:0:5790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788622800.457860:0:5790:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788622800.457861:0:5790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622800.457862:0:5790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788622800.457881:0:5790:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002af26c98 from lustre-MDT0000 10000000:01000000:2.0:1788622800.457906:0:5790:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788622800.457908:0:5790:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788622800.457912:0:5790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff997e06120000 10000000:01000000:2.0:1788622800.457922:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788622800.457930:0:5790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff997e06120000 from 1 10000000:01000000:2.0:1788622800.457932:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788622800.457969:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622800.457980:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622800.457988:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622800.458005:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efbaf887 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684288:0@lo:101: 00000100:00100000:2.0:1788622800.458039:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622800.458090:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 000000004acd7c27 going to sleep for 11 seconds 00000100:00100000:3.0:1788622800.458156:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684288 00000100:00100000:3.0:1788622800.458162:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684288 00000100:00100000:3.0:1788622800.458201:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788622800.458209:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f94d2c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:5790:x1875506866684288:12345-0@lo:101: 00010000:00010000:3.0:1788622800.458220:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622800.458231:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b132a02/0xef842f43731d6419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6412 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.458250:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b132a02/0xef842f43731d6419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6412 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.458258:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b132a02/0xef842f43731d6419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6412 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622800.458267:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b132a02, rc 0) 00000100:00100000:3.0:1788622800.458301:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f94d2c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+6:5790:x1875506866684288:12345-0@lo:101: Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622800.458312:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788622800.458562:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efbaf887 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684288:0@lo:101: 00010000:00010000:1.0:1788622800.458585:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.458592:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622800.458804:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005abf2de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684416:0@lo:501: 00000100:00100000:1.0:1788622800.458836:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622800.458859:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8820e94 going to sleep for 11 seconds 00000100:00100000:2.0:1788622800.458925:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684416 00000100:00100000:2.0:1788622800.458930:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684416 00000100:00100000:2.0:1788622800.458956:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788622800.458961:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e377d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+6:5790:x1875506866684416:12345-0@lo:501: 00000100:00100000:2.0:1788622800.459184:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e377d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+6:5790:x1875506866684416:12345-0@lo:501: Request processed in 223us (347us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788622800.459191:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788622800.459592:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005abf2de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684416:0@lo:501: 10000000:01000000:1.0:1788622800.459780:0:5790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788622800.459795:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.459804:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 0000000093429a00/0xef842f43731d6412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622800.459813:0:5790:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff997e0835b000 10000000:01000000:1.0:1788622800.459817:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788622800.459821:0:5790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff997e0835b000 10000000:01000000:1.0:1788622800.459824:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788622800.459826:0:5790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff997e0835b000 from 1 10000000:01000000:1.0:1788622800.459829:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788622800.459854:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.459860:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.459867:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622800.459881:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005abf2de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684544:0@lo:101: 00000100:00100000:1.0:1788622800.459913:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622800.459936:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8820e94 going to sleep for 11 seconds 00000100:00100000:1.0:1788622800.459960:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684544 00000100:00100000:1.0:1788622800.459966:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684544 00000100:00100000:1.0:1788622800.460013:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788622800.460025:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb646a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+6:5790:x1875506866684544:12345-0@lo:101: 00010000:00010000:1.0:1788622800.460035:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622800.460046:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec6ac945/0xef842f43731d6427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6420 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460065:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec6ac945/0xef842f43731d6427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6420 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460074:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec6ac945/0xef842f43731d6427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6420 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460082:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec6ac945, rc 0) 00000100:00100000:1.0:1788622800.460113:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb646a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+7:5790:x1875506866684544:12345-0@lo:101: Request processed in 89us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622800.460119:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788622800.460240:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005abf2de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684544:0@lo:101: 00010000:00010000:1.0:1788622800.460251:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460259:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622800.460270:0:5790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788622800.460277:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460282:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 0000000059162675/0xef842f43731d6420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622800.460298:0:5790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788622800.460301:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788622800.460304:0:5790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff997e0835b000 10000000:01000000:1.0:1788622800.460306:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788622800.460309:0:5790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788622800.460311:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788622800.460324:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460329:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.460335:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622800.460346:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005abf2de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684672:0@lo:101: 00000100:00100000:1.0:1788622800.460371:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622800.460384:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8820e94 going to sleep for 11 seconds 00000100:00100000:1.0:1788622800.460401:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684672 00000100:00100000:1.0:1788622800.460405:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684672 00000100:00100000:1.0:1788622800.461290:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788622800.461303:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a8f790e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+7:5790:x1875506866684672:12345-0@lo:101: 00010000:00010000:1.0:1788622800.461314:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622800.461325:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006591db63/0xef842f43731d6435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d642e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.461347:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006591db63/0xef842f43731d6435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d642e expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.461373:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006591db63/0xef842f43731d6435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d642e expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622800.461381:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006591db63, rc 0) 00000100:00100000:1.0:1788622800.461453:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a8f790e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+8:5790:x1875506866684672:12345-0@lo:101: Request processed in 153us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622800.461459:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788622800.463105:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005abf2de5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684672:0@lo:101: 00010000:00010000:0.0:1788622800.463149:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622800.463162:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622800.463244:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a338c896 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684800:0@lo:501: 00000100:00100000:0.0:1788622800.463296:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622800.463338:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8e3e008 going to sleep for 11 seconds 00000100:00100000:3.0:1788622800.463470:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684800 00000100:00100000:3.0:1788622800.463477:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684800 00000100:00100000:3.0:1788622800.463522:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788622800.463529:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057e4a73c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+8:5790:x1875506866684800:12345-0@lo:501: 00000100:00100000:3.0:1788622800.463892:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057e4a73c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5790:x1875506866684800:12345-0@lo:501: Request processed in 362us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622800.463899:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788622800.464070:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a338c896 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684800:0@lo:501: 00000100:00100000:2.0:1788622800.464105:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684928:0@lo:503: 00000100:00100000:2.0:1788622800.464161:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622800.464182:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000712df72a going to sleep for 11 seconds 00000100:00100000:3.0:1788622800.464422:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866684928 00000100:00100000:3.0:1788622800.464428:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866684928 00000100:00100000:3.0:1788622800.464464:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788622800.464470:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3eb35a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5790:x1875506866684928:12345-0@lo:503: 00000100:00100000:3.0:1788622800.464864:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3eb35a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5790:x1875506866684928:12345-0@lo:503: Request processed in 393us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622800.464871:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788622800.465056:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866684928:0@lo:503: 00000100:00100000:2.0:1788622800.466321:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5832:1875506866685056:0@lo:502: 00000100:00100000:2.0:1788622800.466403:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622800.466468:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a35d80ca going to sleep for 11 seconds 00000100:00100000:3.0:1788622800.466790:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685056 00000100:00100000:3.0:1788622800.466799:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685056 00000100:00100000:3.0:1788622800.466838:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788622800.466847:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8b35ed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5832:x1875506866685056:12345-0@lo:502: 00000100:00100000:3.0:1788622800.467095:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8b35ed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5832:x1875506866685056:12345-0@lo:502: Request processed in 249us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622800.467102:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788622800.467544:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5832:1875506866685056:0@lo:502: 00000020:01000000:2.0:1788622800.467702:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788622800.467714:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622800.467726:0:5832:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788622800.467731:0:5832:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788622800.467735:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788622800.467776:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e05a4171) 00000020:00000080:2.0:1788622800.467795:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788622800.467801:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788622800.467900:0:5832:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788622800.467907:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d6443 00000020:00000080:2.0:1788622800.468293:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788622800.468299:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622800.471584:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622800.471594:0:5832:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788622800.471979:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622800.471990:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622800.471992:0:5832:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788622800.471997:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788622800.472013:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008c610444) 00000020:00000080:0.0:1788622800.472038:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788622800.472044:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788622800.472046:0:5832:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788622800.472062:0:5832:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788622800.472071:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788622800.472396:0:5832:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002af26c98 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788622800.472411:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d15b4d1b) 00000020:00000080:0.0:1788622800.472536:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788622800.472727:0:5832:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788622800.472736:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d6458 00000020:00000080:0.0:1788622800.473006:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788622800.473012:0:5832:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788622800.473017:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xef842f43731d645f 00080000:01000000:0.0:1788622800.473023:0:5832:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788622800.473026:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d6466 00080000:10000000:0.0:1788622800.473971:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788622800.476109:0:5832:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788622800.483284:0:5832:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788622800.626706:0:5832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788622800.628161:0:5832:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788622800.637061:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788622800.637500:0:5832:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788622800.711161:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000000fa79ba) 00000020:00000080:3.0:1788622800.711190:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788622800.711262:0:5832:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788622800.711268:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d6474 00000020:00000080:0.0:1788622800.712270:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788622800.716197:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788622800.782094:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788622800.811903:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788622800.831841:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622800.872972:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622800.939323:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622801.049330:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788622801.112226:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xef842f43731d647b 00000020:00000080:3.0:1788622801.112839:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788622801.112851:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622801.112858:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622801.112861:0:5832:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788622801.112863:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788622801.112870:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622801.112871:0:5832:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788622801.112875:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788622801.112910:0:5832:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788622801.112923:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622801.112927:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622801.112928:0:5832:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788622801.112930:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788622801.112933:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622801.112934:0:5832:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788622801.112936:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788622801.112938:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788622801.112997:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb724b41 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5832:1875506866685184:0@lo:502: 00000100:00100000:3.0:1788622801.113082:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622801.113199:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daab3419 going to sleep for 11 seconds 00000100:00100000:0.0:1788622801.113304:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685184 00000100:00100000:0.0:1788622801.113313:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685184 00000100:00100000:0.0:1788622801.113396:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788622801.113417:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af3c6d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5832:x1875506866685184:12345-0@lo:502: 00000100:00100000:0.0:1788622801.113895:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af3c6d10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5832:x1875506866685184:12345-0@lo:502: Request processed in 491us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622801.113905:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788622801.114015:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb724b41 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5832:1875506866685184:0@lo:502: 00000020:01000000:1.0:1788622801.114051:0:5832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788622801.114057:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622801.114059:0:5832:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788622801.114065:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788622801.114360:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788622801.114384:0:5790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788622801.114411:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.114422:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 000000008fe71142/0xef842f43731d642e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622801.114430:0:5790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e0835b000 from 1 10000000:01000000:2.0:1788622801.114434:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788622801.114471:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.114492:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.114502:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622801.114524:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685312:0@lo:101: 00000100:00100000:2.0:1788622801.114570:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622801.114970:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3d5bfce going to sleep for 11 seconds 00000100:00100000:3.0:1788622801.115014:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685312 00000100:00100000:3.0:1788622801.115022:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685312 00000100:00100000:1.0:1788622801.115128:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788622801.115138:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874cd5c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:5790:x1875506866685312:12345-0@lo:101: 00010000:00010000:1.0:1788622801.115150:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622801.115168:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6482 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.115193:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6482 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.115203:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6482 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.115212:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032b8b496, rc 0) 00000100:00100000:1.0:1788622801.115268:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874cd5c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:5790:x1875506866685312:12345-0@lo:101: Request processed in 132us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622801.115275:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788622801.115357:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685312:0@lo:101: 00010000:00010000:2.0:1788622801.115372:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.115381:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622801.116066:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685440:0@lo:256: 00000100:00100000:2.0:1788622801.116116:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622801.116150:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3d5bfce going to sleep for 11 seconds 00000100:00100000:1.0:1788622801.116282:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685440 00000100:00100000:1.0:1788622801.116290:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685440 00000100:00100000:1.0:1788622801.116331:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788622801.116338:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1590ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:5790:x1875506866685440:12345-0@lo:256: 20000000:01000000:1.0:1788622801.116355:0:5803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788622801.116361:0:5803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788622801.116581:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1590ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:5790:x1875506866685440:12345-0@lo:256: Request processed in 242us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622801.116588:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788622801.116661:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ca9df33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685440:0@lo:256: 10000000:01000000:0.0:1788622801.117288:0:5790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788622801.117312:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.117339:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622801.117351:0:5790:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e0835b000 from 1 10000000:01000000:0.0:1788622801.117355:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788622801.117399:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.117483:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.117494:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622801.117513:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c26cd1ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685568:0@lo:101: 00000100:00100000:0.0:1788622801.117554:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622801.117574:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5c3002e going to sleep for 11 seconds 00000100:00100000:1.0:1788622801.117674:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685568 00000100:00100000:1.0:1788622801.117681:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685568 00000100:00100000:1.0:1788622801.117720:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788622801.117726:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000533db2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:5790:x1875506866685568:12345-0@lo:101: 00010000:00010000:1.0:1788622801.117737:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622801.117773:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6490 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.117794:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6490 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.117804:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6490 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.117812:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ced9661, rc 0) 00000100:00100000:1.0:1788622801.117841:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000533db2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866685568:12345-0@lo:101: Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622801.117856:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788622801.117928:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c26cd1ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685568:0@lo:101: 00010000:00010000:0.0:1788622801.117941:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.117948:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622801.117993:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c26cd1ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685696:0@lo:501: 00000100:00100000:0.0:1788622801.118017:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622801.118043:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5c3002e going to sleep for 11 seconds 00000100:00100000:1.0:1788622801.118092:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685696 00000100:00100000:1.0:1788622801.118096:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685696 00000100:00100000:1.0:1788622801.118114:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788622801.118118:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000259c17c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866685696:12345-0@lo:501: 00000100:00100000:1.0:1788622801.118838:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000259c17c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866685696:12345-0@lo:501: Request processed in 718us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622801.118846:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788622801.119224:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c26cd1ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685696:0@lo:501: 00000100:00100000:0.0:1788622801.119264:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c26cd1ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685824:0@lo:503: 00000100:00100000:0.0:1788622801.119306:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622801.119375:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5c3002e going to sleep for 11 seconds 00000100:00100000:2.0:1788622801.119470:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685824 00000100:00100000:2.0:1788622801.119476:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685824 00000100:00100000:2.0:1788622801.119555:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788622801.119562:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b943fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866685824:12345-0@lo:503: 00000040:00080000:2.0:1788622801.119608:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788622801.119661:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b943fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866685824:12345-0@lo:503: Request processed in 99us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622801.119668:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788622801.119779:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c26cd1ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685824:0@lo:503: 00000040:00080000:0.0:1788622801.120650:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788622801.120916:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788622801.120936:0:5790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788622801.120952:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.120962:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622801.121010:0:5790:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788622801.121013:0:5790:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff997e0835b000 10000000:01000000:1.0:1788622801.121016:0:5790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff997e0835b000 10000000:01000000:1.0:1788622801.121020:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788622801.121026:0:5790:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e0835b000 from 1 10000000:01000000:1.0:1788622801.121029:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788622801.121061:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.121071:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.121082:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622801.121114:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685952:0@lo:101: 00000100:00100000:1.0:1788622801.121166:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622801.121520:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049897b0b going to sleep for 11 seconds 00000100:00100000:3.0:1788622801.121601:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866685952 00000100:00100000:3.0:1788622801.121610:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866685952 00000100:00100000:3.0:1788622801.121646:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788622801.121654:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b1887e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866685952:12345-0@lo:101: 00010000:00010000:3.0:1788622801.121668:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622801.121689:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000560e5be9/0xef842f43731d64a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d649e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.121724:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000560e5be9/0xef842f43731d64a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d649e expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.121735:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000560e5be9/0xef842f43731d64a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d649e expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.121769:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000560e5be9, rc 0) 00000100:00100000:3.0:1788622801.121814:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b1887e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5790:x1875506866685952:12345-0@lo:101: Request processed in 160us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622801.121821:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788622801.121966:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866685952:0@lo:101: 00010000:00010000:1.0:1788622801.121980:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.121988:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622801.122041:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866686080:0@lo:501: 00000100:00100000:1.0:1788622801.122068:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622801.122084:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049897b0b going to sleep for 11 seconds 00000100:00100000:3.0:1788622801.122138:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686080 00000100:00100000:3.0:1788622801.122142:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686080 00000100:00100000:3.0:1788622801.122159:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788622801.122164:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003edf4424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5790:x1875506866686080:12345-0@lo:501: 00000100:00100000:3.0:1788622801.122684:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003edf4424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5790:x1875506866686080:12345-0@lo:501: Request processed in 518us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622801.122693:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788622801.122865:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866686080:0@lo:501: 00000100:00100000:1.0:1788622801.122897:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866686208:0@lo:503: 00000100:00100000:1.0:1788622801.122937:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622801.123002:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049897b0b going to sleep for 11 seconds 00000100:00100000:2.0:1788622801.123037:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686208 00000100:00100000:2.0:1788622801.123043:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686208 00000100:00100000:2.0:1788622801.123076:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788622801.123083:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf02502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5790:x1875506866686208:12345-0@lo:503: 00000100:00100000:2.0:1788622801.123580:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf02502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5790:x1875506866686208:12345-0@lo:503: Request processed in 496us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622801.123588:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788622801.123657:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866686208:0@lo:503: 00000100:00100000:2.0:1788622801.124092:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d73474eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5837:1875506866686336:0@lo:502: 00000100:00100000:2.0:1788622801.124143:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622801.124223:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000229b7b42 going to sleep for 11 seconds 00000100:00100000:3.0:1788622801.124265:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686336 00000100:00100000:3.0:1788622801.124271:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686336 00000100:00100000:3.0:1788622801.124336:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788622801.124344:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006be7640a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5837:x1875506866686336:12345-0@lo:502: 00000100:00100000:3.0:1788622801.124678:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006be7640a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5837:x1875506866686336:12345-0@lo:502: Request processed in 335us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622801.124685:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788622801.124780:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d73474eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5837:1875506866686336:0@lo:502: 00000020:01000004:2.0:1788622801.124844:0:5837:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788622801.124859:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a2042a99) 00000020:00000080:2.0:1788622801.124880:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788622801.124962:0:5837:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002af26c98 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788622801.124966:0:5837:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002af26c98 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788622801.124969:0:5837:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002af26c98 4 00010000:00080000:2.0:1788622801.124998:0:5837:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000974fa1bd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.119@tcp at head 00010000:00010000:2.0:1788622801.127079:0:5837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788622801.128007:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788622801.128047:0:5837:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788622801.128062:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xef842f43731d64b3 00000100:00080000:2.0:1788622801.128074:0:5837:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788622801.128081:0:5837:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000974fa1bd using connection 192.168.204.119@tcp/0@lo 00000100:00100000:2.0:1788622801.128123:0:5837:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d73474eb x1875506866686464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788622801.128151:0:5837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788622801.128395:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d73474eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866686464:0@lo:38: 00000100:00100000:0.0:1788622801.128550:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622801.128823:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686464 00000100:00100000:2.0:1788622801.128831:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686464 00000100:00100000:2.0:1788622801.128899:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622801.128905:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c26cd1ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875506866686464:12345-0@lo:38: 00000100:00100000:2.0:1788622801.128986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c26cd1ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875506866686464:12345-0@lo:38: Request processed in 80us (438us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788622801.128994:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788622801.129065:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788622801.129074:0:3277:0:(import.c:65:import_set_state_nolock()) 00000000974fa1bd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788622801.129086:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788622801.129089:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d73474eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866686464:0@lo:38: 00000100:00100000:3.0:1788622801.132324:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000749573a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5837:1875506866686592:0@lo:502: 00000100:00100000:3.0:1788622801.132425:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622801.132476:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8820e94 going to sleep for 11 seconds 00000100:00100000:2.0:1788622801.132871:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686592 00000100:00100000:2.0:1788622801.132880:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686592 00000100:00100000:2.0:1788622801.132931:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788622801.132938:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fd8a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5837:x1875506866686592:12345-0@lo:502: 00000100:00100000:2.0:1788622801.133180:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fd8a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5837:x1875506866686592:12345-0@lo:502: Request processed in 242us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622801.133188:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788622801.133241:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000749573a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5837:1875506866686592:0@lo:502: 00000040:00080000:2.0:1788622801.133273:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788622801.133505:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788622801.133524:0:5790:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788622801.133548:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622801.133559:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 00000000fc098b67/0xef842f43731d649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788622801.133618:0:5790:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788622801.133621:0:5790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788622801.133623:0:5790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788622801.133624:0:5790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788622801.133625:0:5790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788622801.133626:0:5790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788622801.133628:0:5790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788622801.133629:0:5790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788622801.133631:0:5790:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788622801.133632:0:5790:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788622801.133634:0:5790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788622801.133635:0:5790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788622801.133638:0:5790:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788622801.133641:0:5790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788622801.133642:0:5790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788622801.133643:0:5790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788622801.133644:0:5790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788622801.133645:0:5790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788622801.133647:0:5790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788622801.133649:0:5790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788622801.133649:0:5790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788622801.133650:0:5790:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788622801.133653:0:5790:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788622801.133654:0:5790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788622801.133655:0:5790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788622801.133672:0:5790:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788622801.133684:0:5790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866686720:0@lo:253: 00000100:00100000:1.0:1788622801.133734:0:5790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622801.133782:0:5790:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078d95c59 going to sleep for 11 seconds 00000100:00100000:1.0:1788622801.133798:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686720 00000100:00100000:1.0:1788622801.133802:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686720 00000100:00100000:1.0:1788622801.133828:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788622801.133834:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f88175a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5790:x1875506866686720:12345-0@lo:253: 20000000:01000000:1.0:1788622801.133856:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788622801.133876:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788622801.176584:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788622801.176637:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788622801.178695:0:5825:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788622801.178716:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788622801.178756:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.178776:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6482 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.178784:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.178832:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6482 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622801.178848:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6482 expref: 12 pid: 5803 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622801.178863:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073f082c6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5825:1875506866686848:0@lo:104: 00000100:00100000:0.0:1788622801.178932:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622801.178995:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ef6ccac going to sleep for 11 seconds 00000100:00100000:2.0:1788622801.179098:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686848 00000100:00100000:2.0:1788622801.179106:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686848 00000100:00100000:2.0:1788622801.179169:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622801.179178:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000747f989e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5825:x1875506866686848:12345-0@lo:104: 00010000:00010000:2.0:1788622801.179192:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.179258:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788622801.179263:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000747f989e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5825:x1875506866686848:12345-0@lo:104: Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622801.179271:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788622801.179291:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622801.179309:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.179316:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052e80184 already unused, calling callback (000000000e068222) 10000000:00010000:2.0:1788622801.179319:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.179326:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622801.179332:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622801.179336:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622801.179366:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.179372:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622801.179390:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.179395:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: 0000000052e80184/0xef842f43731d6482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6489 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622801.179530:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622801.179533:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622801.179534:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622801.179598:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087606dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866686976:0@lo:103: 00000100:00100000:2.0:1788622801.179628:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622801.179854:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073f082c6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5825:1875506866686848:0@lo:104: 00010000:00010000:0.0:1788622801.179878:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622801.180981:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866686976 00000100:00100000:3.0:1788622801.180992:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866686976 00010000:00010000:3.0:1788622801.181019:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6482 expref: 13 pid: 5803 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622801.181054:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788622801.181063:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e8970d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3279:x1875506866686976:12345-0@lo:103: 00010000:00010000:3.0:1788622801.181074:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622801.181079:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6482 expref: 13 pid: 5803 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181090:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6482 expref: 13 pid: 5803 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181105:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032b8b496/0xef842f43731d6489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6482 expref: 13 pid: 5803 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181121:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181127:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788622801.181143:0:5794:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002428039s 00010000:00010000:3.0:1788622801.181147:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181164:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181170:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181175:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181180:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005aed431f already unused, calling callback (000000003e6cd363) 00010000:00010000:3.0:1788622801.181183:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181190:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181205:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181215:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622801.181270:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e8970d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3279:x1875506866686976:12345-0@lo:103: Request processed in 209us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622801.181277:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788622801.181299:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181306:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622801.181311:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005aed431f/0xef842f43731d64ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622801.181815:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087606dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866686976:0@lo:103: 00000100:00100000:0.0:1788622801.186780:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f88175a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5790:x1875506866686720:12345-0@lo:253: Request processed in 52937us (53036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622801.186797:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788622801.186949:0:5790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ffdae8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5790:1875506866686720:0@lo:253: 10000000:01000000:1.0:1788622801.186966:0:5790:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788622801.186969:0:5790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788622801.186971:0:5790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788622801.186972:0:5790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788622801.186973:0:5790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788622801.186974:0:5790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788622801.186975:0:5790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788622801.186976:0:5790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788622801.186977:0:5790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788622801.186979:0:5790:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788622801.186980:0:5790:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788622801.186981:0:5790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788622801.186983:0:5790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788622801.186997:0:5790:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788622801.192649:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788622801.193108:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788622801.193339:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788622801.193606:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788622801.194066:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622801.194271:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788622801.195081:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622801.195253:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788622801.195535:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622801.195729:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788622801.196498:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622801.196678:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788622801.236619:0:5790:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788622801.266179:0:5790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788622801.266717:0:5842:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788622801.266723:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788622801.267020:0:5843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788622801.275271:0:5790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788622801.277119:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788622801.277523:0:5790:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788622801.277536:0:5790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788622801.277694:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788622801.278634:0:5790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788622801.279180:0:5790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788622801.279215:0:5790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788622801.279461:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788622801.281000:0:5790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788622801.282431:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788622801.282577:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788622801.282796:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788622801.282963:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788622801.283115:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788622801.283254:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788622801.283402:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788622801.284210:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788622801.284392:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788622801.284582:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788622801.284796:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788622801.284966:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788622801.285130:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788622801.285290:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788622801.285461:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788622801.285600:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788622801.286001:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788622801.286138:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788622801.286291:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788622801.286468:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788622801.286623:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788622801.286847:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788622801.288108:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788622801.288282:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788622801.288569:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788622801.288731:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788622801.288984:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788622801.289147:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788622801.289298:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788622801.289917:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788622801.290087:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788622801.290243:0:5790:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788622801.290606:0:5790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788622801.328943:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788622801.385200:0:5790:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788622801.385251:0:5790:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa59d41dbf988 00100000:10000000:2.0:1788622801.385261:0:5790:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788622801.387436:0:5790:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788622801.387454:0:5790:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788622801.387468:0:5790:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788622801.387494:0:5790:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788622801.427735:0:5843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788622801.427862:0:5843:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788622801.427867:0:5843:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788622801.835919:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622802.862027:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622803.884225:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622804.910092:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622805.936850:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788622806.572152:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788622806.572160:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e0835b000 from 3 10000000:01000000:0.0:1788622806.572165:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788622806.572236:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622806.572251:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622806.572261:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622806.572286:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073f082c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866687104:0@lo:101: 00000100:00100000:0.0:1788622806.572413:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622806.572475:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e0b6faa going to sleep for 11 seconds 00000100:00100000:2.0:1788622806.572490:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687104 00000100:00080000:0.0:1788622806.572499:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1788622806.572500:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687104 00000100:00080000:0.0:1788622806.572506:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788622806.572510:0:8:0:(import.c:65:import_set_state_nolock()) 00000000974fa1bd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788622806.572519:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000974fa1bd using connection 192.168.204.119@tcp/0@lo 00000100:00100000:0.0:1788622806.572542:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000018c74eb2 x1875506866687232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788622806.572554:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788622806.572565:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc7e8f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5806:x1875506866687104:12345-0@lo:101: 00000100:00100000:0.0:1788622806.572576:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018c74eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866687232:0@lo:38: 00010000:00010000:2.0:1788622806.572579:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622806.572597:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006a7e119/0xef842f43731d64c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d64c1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622806.572623:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788622806.572636:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006a7e119/0xef842f43731d64c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d64c1 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622806.572648:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006a7e119/0xef842f43731d64c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d64c1 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622806.572663:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687232 00000100:00100000:0.0:1788622806.572668:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687232 00010000:00010000:2.0:1788622806.572670:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006a7e119, rc 0) 00000100:00100000:0.0:1788622806.572694:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788622806.572700:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000511320a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875506866687232:12345-0@lo:38: 00000100:00100000:2.0:1788622806.572718:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc7e8f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866687104:12345-0@lo:101: Request processed in 154us (304us total) trans 0 rc 0/0 00010000:00080000:0.0:1788622806.572724:0:5811:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000100:00100000:2.0:1788622806.572728:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:0.0:1788622806.572792:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xef842f43731d64cf 00000004:00100000:0.0:1788622806.572836:0:5811:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788622806.572974:0:5811:0:(import.c:65:import_set_state_nolock()) 00000000861d59b5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788622806.573024:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000511320a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875506866687232:12345-0@lo:38: Request processed in 323us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622806.573040:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788622806.573083:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073f082c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866687104:0@lo:101: 00010000:00010000:0.0:1788622806.573102:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788622806.573109:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000018c74eb2 x1875506866687232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788622816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788622806.573111:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788622806.573135:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788622806.573142:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788622806.573148:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788622806.573150:0:3277:0:(import.c:65:import_set_state_nolock()) 00000000974fa1bd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788622806.573156:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018c74eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866687232:0@lo:38: 00000100:00100000:0.0:1788622806.573175:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073f082c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866687360:0@lo:256: 00000100:00100000:0.0:1788622806.573206:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622806.573235:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e0b6faa going to sleep for 11 seconds 00000100:00100000:2.0:1788622806.573263:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687360 00000100:00100000:2.0:1788622806.573268:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687360 00000100:00100000:2.0:1788622806.573298:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788622806.573304:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cf7b120 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866687360:12345-0@lo:256: 20000000:01000000:2.0:1788622806.573318:0:5804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788622806.573332:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788622806.573336:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788622806.573411:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cf7b120 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866687360:12345-0@lo:256: Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622806.573418:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788622806.573549:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073f082c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866687360:0@lo:256: 10000000:01000000:0.0:1788622806.573587:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788622806.573593:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622806.573610:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: 00000000f85153d7/0xef842f43731d64c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788622806.883062:0:6086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788622806.956517:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622807.981467:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622809.005067:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622810.028046:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622811.051992:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622811.692002:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068775ef5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866687616:0@lo:400: 00000100:00100000:0.0:1788622811.692137:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622811.692204:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622811.692293:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687616 00000100:00100000:2.0:1788622811.692303:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687616 00000100:00100000:2.0:1788622811.692352:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622811.692370:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073f082c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866687616:12345-0@lo:400: 00000100:00100000:2.0:1788622811.692424:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073f082c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866687616:12345-0@lo:400: Request processed in 56us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622811.692433:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788622811.692483:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe9b6dd8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866687488:0@lo:400: 00000100:00100000:0.0:1788622811.692535:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788622811.692575:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000068775ef5 x1875506866687616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622811.692590:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068775ef5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866687616:0@lo:400: 00000100:00100000:2.0:1788622811.692662:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687488 00000100:00100000:2.0:1788622811.692666:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687488 00000100:00100000:2.0:1788622811.692697:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788622811.692702:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bac0c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3281:x1875506866687488:12345-0@lo:400: 00000100:00100000:2.0:1788622811.692732:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bac0c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3281:x1875506866687488:12345-0@lo:400: Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622811.692738:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788622811.692916:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe9b6dd8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866687488:0@lo:400: 00010000:00010000:2.0:1788622812.080558:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788622812.719215:0:6288:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0c56da50 20000000:00000080:0.0:1788622812.719236:0:6288:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997e08537400 uarg=0000000000000000 20000000:01000000:0.0:1788622812.719272:0:6288:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788622812.719281:0:6288:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788622812.719286:0:6288:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788622812.719875:0:6288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788622812.719889:0:6288:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788622812.725307:0:6288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788622812.725620:0:6288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788622812.725679:0:6288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788622812.725726:0:6288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788622812.725787:0:6288:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788622812.725851:0:6288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.725871:0:6288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6490 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.725878:0:6288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.725920:0:6288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6490 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.725935:0:6288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6490 expref: 11 pid: 5803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622812.725957:0:6288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6288:1875506866687744:0@lo:104: 00000100:00100000:0.0:1788622812.726023:0:6288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622812.726081:0:6288:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2e54be9 going to sleep for 11 seconds 00000100:00100000:3.0:1788622812.726985:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687744 00000100:00100000:3.0:1788622812.726998:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687744 00000100:00100000:3.0:1788622812.727060:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788622812.727069:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2dce24b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:6288:x1875506866687744:12345-0@lo:104: 00010000:00010000:3.0:1788622812.727084:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622812.727151:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788622812.727156:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2dce24b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:6288:x1875506866687744:12345-0@lo:104: Request processed in 89us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622812.727163:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788622812.727318:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622812.727324:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727331:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001859d253 already unused, calling callback (000000000e068222) 10000000:00010000:2.0:1788622812.727335:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727343:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622812.727349:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622812.727354:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788622812.727401:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727425:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622812.727446:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727452:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: 000000001859d253/0xef842f43731d6490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6497 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727471:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622812.727473:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622812.727474:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622812.727497:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab4583f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866687872:0@lo:103: 00000100:00100000:2.0:1788622812.727533:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622812.727584:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866687872 00000100:00100000:2.0:1788622812.727588:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866687872 00010000:00010000:2.0:1788622812.727605:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6490 expref: 12 pid: 5803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622812.727628:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622812.727634:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074ae5cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3278:x1875506866687872:12345-0@lo:103: 00010000:00010000:2.0:1788622812.727645:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622812.727649:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6490 expref: 12 pid: 5803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727658:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6490 expref: 12 pid: 5803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727674:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727693:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727709:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727716:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727722:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727728:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727732:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a89c49e already unused, calling callback (000000003e6cd363) 00010000:00010000:2.0:1788622812.727780:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727788:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727796:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622812.727806:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622812.727836:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074ae5cb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3278:x1875506866687872:12345-0@lo:103: Request processed in 202us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622812.727842:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622812.727879:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab4583f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866687872:0@lo:103: 00010000:00010000:0.0:1788622812.728978:0:6288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008ced9661/0xef842f43731d6497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6490 expref: 11 pid: 5803 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622812.728994:0:6288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6288:1875506866687744:0@lo:104: 00010000:00010000:0.0:1788622812.729012:0:6288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.729020:0:6288:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.729024:0:6288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622812.729029:0:6288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a89c49e/0xef842f43731d64d6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622813.101665:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622814.124358:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788622814.130303:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788622814.130313:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e0835b000 from 1 10000000:01000000:0.0:1788622814.130320:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788622814.130365:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: 00000000cac06742/0xef842f43731d64dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.130378:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: 00000000cac06742/0xef842f43731d64dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.130390:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: 00000000cac06742/0xef842f43731d64dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622814.130422:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866688000:0@lo:101: 00000100:00100000:0.0:1788622814.130511:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622814.130563:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006d1a465 going to sleep for 11 seconds 00000100:00100000:0.0:1788622814.130587:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688000 00000100:00100000:0.0:1788622814.130594:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688000 00000100:00100000:0.0:1788622814.130640:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788622814.130648:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b24f3ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:5806:x1875506866688000:12345-0@lo:101: 00010000:00010000:0.0:1788622814.130661:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622814.130673:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1b6a3a0/0xef842f43731d64e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d64dd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.130697:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1b6a3a0/0xef842f43731d64e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d64dd expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.130708:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1b6a3a0/0xef842f43731d64e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d64dd expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.130717:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1b6a3a0, rc 0) 00000100:00100000:0.0:1788622814.130782:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b24f3ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866688000:12345-0@lo:101: Request processed in 135us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622814.130788:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788622814.130834:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866688000:0@lo:101: 00010000:00010000:0.0:1788622814.130849:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: 00000000cac06742/0xef842f43731d64dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.130856:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: 00000000cac06742/0xef842f43731d64dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622814.130919:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866688128:0@lo:501: 00000100:00100000:0.0:1788622814.130944:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622814.130958:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006d1a465 going to sleep for 11 seconds 00000100:00100000:0.0:1788622814.130970:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688128 00000100:00100000:0.0:1788622814.130974:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688128 00000100:00100000:0.0:1788622814.130994:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788622814.130999:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c512b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866688128:12345-0@lo:501: 00000100:00100000:0.0:1788622814.131281:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c512b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866688128:12345-0@lo:501: Request processed in 282us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622814.131289:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788622814.131320:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866688128:0@lo:501: 00000100:00100000:0.0:1788622814.131345:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866688256:0@lo:503: 00000100:00100000:0.0:1788622814.131382:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622814.131396:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006d1a465 going to sleep for 11 seconds 00000100:00100000:0.0:1788622814.131408:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688256 00000100:00100000:0.0:1788622814.131412:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688256 00000100:00100000:0.0:1788622814.131432:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788622814.131438:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c40ffa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866688256:12345-0@lo:503: 00000100:00100000:0.0:1788622814.131566:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c40ffa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866688256:12345-0@lo:503: Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622814.131573:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788622814.131610:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866688256:0@lo:503: 00000100:00100000:0.0:1788622814.131824:0:6327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6327:1875506866688384:0@lo:502: 00000100:00100000:0.0:1788622814.131855:0:6327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622814.131880:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688384 00000100:00100000:0.0:1788622814.131884:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688384 00000100:00100000:0.0:1788622814.131905:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788622814.131909:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaa7ad0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6327:x1875506866688384:12345-0@lo:502: 00000100:00100000:0.0:1788622814.132009:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaa7ad0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6327:x1875506866688384:12345-0@lo:502: Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622814.132016:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788622814.132043:0:6327:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093c5151f going to sleep for 11 seconds 00000100:00100000:0.0:1788622814.132055:0:6327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077b80b7f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6327:1875506866688384:0@lo:502: 00000020:01000000:0.0:1788622814.132075:0:6327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622814.132085:0:6327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622814.132087:0:6327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788622814.132093:0:6327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e0835b000 00000020:00000080:0.0:1788622814.132096:0:6327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788622814.132137:0:6327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6327:1875506866688512:0@lo:502: 00000100:00100000:0.0:1788622814.132167:0:6327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622814.132187:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688512 00000100:00100000:0.0:1788622814.132190:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688512 00000100:00100000:0.0:1788622814.132209:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788622814.132215:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6327:x1875506866688512:12345-0@lo:502: 00000100:00100000:0.0:1788622814.132304:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6327:x1875506866688512:12345-0@lo:502: Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622814.132310:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788622814.132338:0:6327:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788622814.132350:0:6327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6327:1875506866688512:0@lo:502: 00000020:01000000:0.0:1788622814.132368:0:6327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622814.132372:0:6327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622814.132374:0:6327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788622814.132382:0:6327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788622814.132432:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788622814.132446:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788622814.132470:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622814.132481:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622815.148044:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622816.172139:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622816.819120:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866688640:0@lo:400: 00000100:00100000:1.0:1788622816.819203:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622816.819280:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866688768:0@lo:400: 00000100:00100000:1.0:1788622816.819313:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622816.821067:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688640 00000100:00100000:0.0:1788622816.821085:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688640 00000100:00100000:0.0:1788622816.821137:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788622816.821147:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3279:x1875506866688640:12345-0@lo:400: 00000100:00100000:0.0:1788622816.821677:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688768 00000100:00100000:0.0:1788622816.821684:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688768 00000100:00100000:0.0:1788622816.821719:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788622816.821728:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866688768:12345-0@lo:400: 00000100:00100000:0.0:1788622816.821825:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866688768:12345-0@lo:400: Request processed in 98us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622816.822006:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788622816.822172:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e3a315500 x1875506866688768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622816.822187:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866688768:0@lo:400: 00000100:00100000:0.0:1788622816.822253:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3279:x1875506866688640:12345-0@lo:400: Request processed in 1109us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622816.822260:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788622816.822535:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866688640:0@lo:400: 00010000:00010000:2.0:1788622817.196283:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622818.228539:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622819.244025:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622820.270532:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788622820.513713:0:6652:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788622820.513717:0:6652:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788622820.515999:0:6652:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff997e1026d000 00000020:01000004:0.0:1788622820.516023:0:6652:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788622820.516036:0:6652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788622820.516050:0:6652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff997e06130000) 00000020:00000080:0.0:1788622820.516068:0:6652:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788622820.555954:0:6652:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788622820.556209:0:6652:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788622820.588171:0:6652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788622820.608533:0:6652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788622820.608576:0:6652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788622820.608637:0:6652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788622820.608664:0:6652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788622820.613373:0:6652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788622820.613390:0:6652:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788622820.613407:0:6652:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xef842f43731d64f2 00000020:01000004:2.0:1788622820.613416:0:6652:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788622820.613441:0:6652:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.119@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788622820.613444:0:6652:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788622820.613451:0:6652:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788622820.613456:0:6652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788622820.613471:0:6652:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff997e061219c0) 00000020:00000080:2.0:1788622820.613486:0:6652:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788622820.614657:0:6652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788622820.614875:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788622820.614882:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788622820.624420:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788622820.624441:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788622820.629521:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788622820.629540:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788622820.642157:0:6652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788622820.642906:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788622820.642926:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788622820.651990:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788622820.652011:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788622820.715974:0:6652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788622820.716477:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788622820.716485:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788622820.719977:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788622820.719994:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788622820.721504:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788622820.721520:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788622820.727274:0:6652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788622820.727859:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788622820.727866:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788622820.729527:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788622820.729547:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788622820.810762:0:6652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788622820.811423:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788622820.811430:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788622820.813099:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788622820.813189:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788622820.814004:0:6652:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788622820.814104:0:6652:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788622820.814112:0:6652:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788622820.874020:0:6652:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788622820.874242:0:6652:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.119@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788622820.874247:0:6652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788622820.874249:0:6652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788622820.874250:0:6652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788622820.874251:0:6652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788622820.874252:0:6652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788622820.874253:0:6652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788622820.874255:0:6652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788622820.874256:0:6652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788622820.874258:0:6652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788622820.874259:0:6652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788622820.874260:0:6652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788622820.874264:0:6652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788622820.874267:0:6652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788622820.874268:0:6652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788622820.874269:0:6652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788622820.874270:0:6652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788622820.874272:0:6652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788622820.874273:0:6652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788622820.874274:0:6652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788622820.874276:0:6652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788622820.874277:0:6652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788622820.874278:0:6652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788622820.874279:0:6652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788622820.874309:0:6652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788622820.874345:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866688896:0@lo:253: 00000100:00100000:3.0:1788622820.874428:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622820.874496:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0606ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622820.874643:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866688896 00000100:00100000:0.0:1788622820.874650:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866688896 00000100:00100000:0.0:1788622820.874702:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788622820.874711:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866688896:12345-0@lo:253: 20000000:01000000:0.0:1788622820.874758:0:5803:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788622820.874763:0:5803:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788622820.874768:0:5803:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788622820.874772:0:5803:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788622820.875835:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788622820.877458:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788622820.877484:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788622820.877546:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788622820.877555:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788622820.877588:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788622820.877640:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788622820.879818:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788622820.879853:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.119@tcp 20000000:01000000:0.0:1788622820.879872:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.119@tcp (null) (null) (null) 00000040:00080000:0.0:1788622820.879911:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788622820.879920:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788622820.879982:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788622820.879991:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.119@tcp (null) (null) 00000040:00080000:0.0:1788622820.882118:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788622820.882146:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788622820.882186:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788622820.882480:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788622820.886434:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788622820.886476:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.119@tcp 20000000:01000000:0.0:1788622820.886480:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.119@tcp (null) (null) (null) 00000040:00080000:0.0:1788622820.886520:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788622820.886528:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788622820.886556:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788622820.886563:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.119@tcp (null) (null) 00000040:00080000:0.0:1788622820.886608:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788622820.886617:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788622820.886648:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788622820.886683:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788622820.886701:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788622820.886703:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788622820.886710:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788622820.886711:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788622820.886713:0:5803:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788622820.886727:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788622820.886729:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788622820.887333:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788622820.887339:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788622820.887870:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788622820.888481:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788622820.888521:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788622820.888603:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788622820.888617:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788622820.888619:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788622820.889920:0:6668:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788622820.890455:0:6668:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788622820.890511:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788622820.891103:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788622820.891152:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788622820.891346:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788622820.891359:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788622820.891361:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788622820.891868:0:6669:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788622820.891915:0:6669:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788622820.892170:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788622820.892600:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788622820.892642:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788622820.892675:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1788622820.892694:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788622820.892714:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.892734:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6412 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.892891:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d642e expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.892899:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d649e expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.892907:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.893471:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d649e expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.893488:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d649e expref: 12 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.893504:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866689024:0@lo:104: 00000100:00100000:2.0:1788622820.893569:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788622820.893685:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d642e expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.893693:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d642e expref: 12 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.893701:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866689152:0@lo:104: 00000100:00100000:2.0:1788622820.893721:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788622820.894539:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6412 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.894550:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6412 expref: 12 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.894560:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866689280:0@lo:104: 00000100:00100000:2.0:1788622820.894586:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622820.894694:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689024 00000100:00100000:1.0:1788622820.894702:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689024 00000100:00100000:1.0:1788622820.894737:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689152 00000100:00100000:1.0:1788622820.894772:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689152 00000100:00100000:1.0:1788622820.894792:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788622820.894800:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:5803:x1875506866689024:12345-0@lo:104: 00010000:00010000:1.0:1788622820.894813:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.894865:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788622820.894871:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:5803:x1875506866689024:12345-0@lo:104: Request processed in 72us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622820.894878:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788622820.894897:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788622820.894903:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866689152:12345-0@lo:104: 00010000:00010000:1.0:1788622820.894910:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.894958:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788622820.894964:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866689152:12345-0@lo:104: Request processed in 61us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622820.894970:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788622820.895140:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788622820.895147:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895155:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622820.895159:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895168:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622820.895176:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622820.895182:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788622820.895227:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895234:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788622820.895252:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895259:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d649e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895271:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622820.895275:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895291:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622820.895295:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895302:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622820.895307:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622820.895312:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788622820.895337:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895343:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788622820.895357:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895363:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d642e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6435 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895372:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622820.895374:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622820.895376:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622820.895388:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866689408:0@lo:103: 00000100:00100000:0.0:1788622820.895419:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622820.895459:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866689536:0@lo:103: 00000100:00100000:0.0:1788622820.895480:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622820.895522:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689408 00000100:00100000:0.0:1788622820.895528:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689408 00010000:00010000:0.0:1788622820.895548:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d649e expref: 13 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622820.895568:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689536 00000100:00100000:0.0:1788622820.895570:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689536 00010000:00010000:0.0:1788622820.895581:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d642e expref: 14 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622820.895608:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788622820.895615:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3281:x1875506866689408:12345-0@lo:103: 00010000:00010000:0.0:1788622820.895626:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622820.895631:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d649e expref: 14 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895642:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d649e expref: 14 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895659:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622820.895690:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3281:x1875506866689408:12345-0@lo:103: Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622820.895703:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788622820.895717:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788622820.895723:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3278:x1875506866689536:12345-0@lo:103: 00010000:00010000:0.0:1788622820.895730:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622820.895734:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d642e expref: 13 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895761:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d642e expref: 13 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.895778:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622820.895807:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3278:x1875506866689536:12345-0@lo:103: Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622820.895813:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788622820.895909:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866689536:0@lo:103: 00000100:00100000:0.0:1788622820.895951:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866689408:0@lo:103: 00010000:00010000:2.0:1788622820.895984:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622820.895996:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689280 00000100:00100000:2.0:1788622820.896001:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689280 00000100:00100000:2.0:1788622820.896025:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788622820.896031:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866689280:12345-0@lo:104: 00010000:00010000:2.0:1788622820.896048:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.896095:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788622820.896101:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866689280:12345-0@lo:104: Request processed in 70us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622820.896109:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788622820.896136:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e03606c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788622820.896152:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fa200/0xef842f43731d64a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d649e expref: 12 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.896164:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866689024:0@lo:104: 00010000:00010000:2.0:1788622820.896173:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735a00/0xef842f43731d6435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d642e expref: 11 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.896181:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866689152:0@lo:104: 00000100:00100000:2.0:1788622820.896188:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866689280:0@lo:104: 00010000:00010000:2.0:1788622820.896206:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896362:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622820.896367:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896373:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622820.896376:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896384:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622820.896390:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622820.896394:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788622820.896412:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896417:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788622820.896442:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896459:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6419 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896472:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622820.896474:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622820.896475:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622820.896481:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788622820.896490:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866689664:0@lo:103: 00000100:00100000:0.0:1788622820.896521:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622820.896544:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689664 00000100:00100000:0.0:1788622820.896548:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689664 00010000:00010000:0.0:1788622820.896561:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6412 expref: 11 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622820.896579:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788622820.896585:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:3278:x1875506866689664:12345-0@lo:103: 00010000:00010000:0.0:1788622820.896592:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622820.896597:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6412 expref: 11 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896604:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6412 expref: 11 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896614:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb200/0xef842f43731d6419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6412 expref: 11 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896625:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896641:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896656:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896664:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896671:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896676:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896681:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bac400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622820.896685:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896693:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896704:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.896714:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622820.896777:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:3278:x1875506866689664:12345-0@lo:103: Request processed in 158us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622820.896784:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788622820.896822:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866689664:0@lo:103: 00010000:00010000:2.0:1788622820.897038:0:5803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.897049:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.897056:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac400/0xef842f43731d6500 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788622820.897081:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788622820.956451:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:6652:x1875506866688896:12345-0@lo:253: Request processed in 81728us (82010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622820.956466:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788622820.956582:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866688896:0@lo:253: 10000000:01000000:1.0:1788622820.956599:0:6652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788622820.956613:0:6652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788622820.956614:0:6652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788622820.956615:0:6652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788622820.956616:0:6652:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788622820.956618:0:6652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788622820.956618:0:6652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788622820.956620:0:6652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788622820.956621:0:6652:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788622820.956623:0:6652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788622820.956639:0:6652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788622820.956661:0:6652:0:(tgt_mount.c:101:server_register_mount()) register mount ffff997e1026d000 from lustre-OST0000 10000000:01000000:1.0:1788622820.956687:0:6652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788622820.956690:0:6652:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788622820.956696:0:6652:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff997e06120000 local copy 10000000:01000000:1.0:1788622820.956700:0:6652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788622820.956737:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.956787:0:6652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.956797:0:6652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622820.956816:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866689792:0@lo:101: 00000100:00100000:1.0:1788622820.956853:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622820.956904:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e04c5bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622820.959178:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689792 00000100:00100000:0.0:1788622820.959297:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689792 00000100:00100000:0.0:1788622820.959384:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788622820.959394:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:6652:x1875506866689792:12345-0@lo:101: 00010000:00010000:0.0:1788622820.959413:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622820.959433:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e00030400/0xef842f43731d650e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6507 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.959462:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00030400/0xef842f43731d650e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6507 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.959474:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e00030400/0xef842f43731d650e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6507 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.959483:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e00030400, rc 0) 00000100:00100000:0.0:1788622820.959708:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:6652:x1875506866689792:12345-0@lo:101: Request processed in 315us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622820.959715:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788622820.960010:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866689792:0@lo:101: 00010000:00010000:2.0:1788622820.960158:0:6652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.960170:0:6652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.960443:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866689920:0@lo:501: 00000100:00100000:2.0:1788622820.960483:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622820.960567:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07978840 going to sleep for 11 seconds 00000100:00100000:3.0:1788622820.960613:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866689920 00000100:00100000:3.0:1788622820.960618:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866689920 00000100:00100000:3.0:1788622820.960695:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788622820.960704:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:6652:x1875506866689920:12345-0@lo:501: 00000100:00100000:3.0:1788622820.961027:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:6652:x1875506866689920:12345-0@lo:501: Request processed in 316us (535us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788622820.961041:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788622820.961434:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866689920:0@lo:501: 10000000:01000000:2.0:1788622820.961453:0:6652:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788622820.961487:0:6652:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788622820.961494:0:6652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.961505:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.961512:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.961579:0:6652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788622820.961610:0:6652:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff997e1026d000 10000000:01000000:2.0:1788622820.961615:0:6652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788622820.961619:0:6652:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff997e06120000 10000000:01000000:2.0:1788622820.961622:0:6652:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788622820.961625:0:6652:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff997e06120000 from 1 10000000:01000000:2.0:1788622820.961628:0:6652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788622820.961966:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.961976:0:6652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.961985:0:6652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.962002:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690048:0@lo:101: 00000100:00100000:2.0:1788622820.962156:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622820.962186:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622820.962396:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690048 00000100:00100000:3.0:1788622820.962405:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690048 00000100:00100000:3.0:1788622820.962449:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788622820.962458:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+10:6652:x1875506866690048:12345-0@lo:101: 00010000:00010000:3.0:1788622820.962470:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622820.962484:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fa000/0xef842f43731d651c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6515 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622820.962508:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fa000/0xef842f43731d651c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6515 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622820.962518:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fa000/0xef842f43731d651c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6515 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622820.962528:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fa000, rc 0) 00000100:00100000:3.0:1788622820.962562:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690048:12345-0@lo:101: Request processed in 105us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622820.962568:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788622820.962705:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690048:0@lo:101: 00010000:00010000:2.0:1788622820.962722:0:6652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.962731:0:6652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622820.962777:0:6652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788622820.962784:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.962792:0:6652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622820.962809:0:6652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788622820.962814:0:6652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788622820.962819:0:6652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788622820.962821:0:6652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788622820.962840:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.962847:0:6652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.962853:0:6652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.962867:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690176:0@lo:101: 00000100:00100000:2.0:1788622820.962893:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622820.962918:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622820.963011:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690176 00000100:00100000:3.0:1788622820.963016:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690176 00000100:00100000:3.0:1788622820.963362:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788622820.963377:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690176:12345-0@lo:101: 00010000:00010000:3.0:1788622820.963386:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622820.963396:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6523 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622820.963411:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6523 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622820.963420:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6523 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622820.963426:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fac00, rc 0) 00000100:00100000:3.0:1788622820.963465:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866690176:12345-0@lo:101: Request processed in 89us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622820.963471:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788622820.963586:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690176:0@lo:101: 00010000:00010000:2.0:1788622820.963600:0:6652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622820.963608:0:6652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622820.963715:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690304:0@lo:501: 00000100:00100000:2.0:1788622820.963832:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622820.963899:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788622820.963969:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622820.963977:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.963984:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622820.963988:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622820.963997:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622820.964016:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622820.964035:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788622820.964151:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690304 00000100:00100000:1.0:1788622820.964157:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690304 00000100:00100000:1.0:1788622820.964351:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788622820.964360:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866690304:12345-0@lo:501: 00000100:00100000:1.0:1788622820.964610:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866690304:12345-0@lo:501: Request processed in 251us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622820.964618:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788622820.964693:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690304:0@lo:501: 00000100:00100000:2.0:1788622820.964732:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690432:0@lo:503: 00000100:00100000:2.0:1788622820.964799:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622820.964932:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622820.965095:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690432 00000100:00100000:3.0:1788622820.965100:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690432 00000100:00100000:3.0:1788622820.965122:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788622820.965128:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866690432:12345-0@lo:503: 00000100:00100000:3.0:1788622820.965422:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866690432:12345-0@lo:503: Request processed in 293us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622820.965430:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788622820.965513:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.965522:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788622820.965555:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.965574:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d6507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xef842f43731d650e expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.965590:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622820.965592:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622820.965594:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622820.965602:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622820.965614:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866690560:0@lo:103: 00000100:00100000:1.0:1788622820.965645:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622820.965676:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690560 00000100:00100000:1.0:1788622820.965681:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690560 00000100:00100000:1.0:1788622820.965711:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788622820.965719:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3281:x1875506866690560:12345-0@lo:103: 00010000:00010000:1.0:1788622820.965729:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622820.965786:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00030400/0xef842f43731d650e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6507 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622820.965798:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622820.965826:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:3281:x1875506866690560:12345-0@lo:103: Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622820.965832:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788622820.965875:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866690560:0@lo:103: 00000100:00100000:2.0:1788622820.965996:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690432:0@lo:503: 00000040:00080000:2.0:1788622820.966442:0:6652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788622820.966503:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690688:0@lo:502: 00000100:00100000:2.0:1788622820.966549:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622820.966630:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788622820.967186:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690688 00000100:00100000:0.0:1788622820.967332:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690688 00000100:00100000:1.0:1788622820.967550:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788622820.967561:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690688:12345-0@lo:502: 00000100:00100000:1.0:1788622820.967829:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690688:12345-0@lo:502: Request processed in 269us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622820.967847:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788622820.967941:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690688:0@lo:502: 00000040:00080000:3.0:1788622820.968231:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788622820.968282:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788622820.968317:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788622820.968377:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788622820.968413:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788622820.968457:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788622820.968490:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690816:0@lo:502: 00000100:00100000:3.0:1788622820.968537:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622820.968960:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d04596180 going to sleep for 11 seconds 00000100:00100000:2.0:1788622820.969433:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690816 00000100:00100000:2.0:1788622820.969443:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690816 00000100:00100000:2.0:1788622820.969482:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788622820.969491:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690816:12345-0@lo:502: 00000100:00100000:2.0:1788622820.969728:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690816:12345-0@lo:502: Request processed in 238us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622820.969735:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788622820.969953:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690816:0@lo:502: 00000040:00080000:3.0:1788622820.970143:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788622820.970156:0:6652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788622820.971107:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788622820.971115:0:6670:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788622820.971121:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622820.971124:0:6670:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788622820.971128:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788622820.971153:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff997d04c4cd40) 00000020:00000080:1.0:1788622820.971177:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788622820.971184:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788622820.971434:0:6670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e1026d000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788622820.971442:0:6670:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788622820.971449:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xef842f43731d6538 00010000:00010000:1.0:1788622820.980150:0:6670:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788622820.980606:0:6670:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788622820.982988:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788622820.983670:0:6670:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788622820.996704:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788622821.004434:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788622821.006891:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788622821.006906:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788622821.006912:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622821.006915:0:6670:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788622821.006918:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788622821.006922:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622821.006923:0:6670:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788622821.006926:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788622821.006927:0:6670:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788622821.006991:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788622821.006995:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622821.006996:0:6670:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788622821.007000:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788622821.016486:0:6652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788622821.016531:0:6652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788622821.016605:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.016620:0:6652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622821.016629:0:6652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e1026d000 from 1 10000000:01000000:0.0:1788622821.016633:0:6652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788622821.016677:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.016685:0:6652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.016696:0:6652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622821.016723:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690944:0@lo:101: 00000100:00100000:0.0:1788622821.016819:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622821.016871:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.018215:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866690944 00000100:00100000:3.0:1788622821.018228:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866690944 00000100:00100000:3.0:1788622821.018283:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788622821.018294:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:6652:x1875506866690944:12345-0@lo:101: 00010000:00010000:3.0:1788622821.018312:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622821.018345:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d653f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.018377:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d653f expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.018389:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d653f expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.018399:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fba00, rc 0) 00000100:00100000:3.0:1788622821.018469:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866690944:12345-0@lo:101: Request processed in 176us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.018476:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788622821.019424:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866690944:0@lo:101: 00010000:00010000:0.0:1788622821.019462:0:6652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.019475:0:6652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622821.019608:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691072:0@lo:501: 00000100:00100000:0.0:1788622821.019657:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622821.019699:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.019921:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691072 00000100:00100000:3.0:1788622821.019928:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691072 00000100:00100000:3.0:1788622821.019969:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788622821.019977:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691072:12345-0@lo:501: 00000100:00100000:3.0:1788622821.020548:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691072:12345-0@lo:501: Request processed in 569us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.020557:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788622821.020683:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691072:0@lo:501: 00000100:00100000:0.0:1788622821.020718:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691200:0@lo:503: 00000100:00100000:0.0:1788622821.023600:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622821.023639:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.024268:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691200 00000100:00100000:3.0:1788622821.024278:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691200 00000100:00100000:3.0:1788622821.024341:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788622821.024351:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691200:12345-0@lo:503: 00000100:00100000:3.0:1788622821.024618:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691200:12345-0@lo:503: Request processed in 269us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.024626:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788622821.025065:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691200:0@lo:503: 00000040:00080000:0.0:1788622821.025334:0:6652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788622821.025404:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691328:0@lo:502: 00000100:00100000:0.0:1788622821.025446:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622821.025478:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36c03600 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.025711:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691328 00000100:00100000:3.0:1788622821.025717:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691328 00000100:00100000:3.0:1788622821.025768:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788622821.025776:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691328:12345-0@lo:502: 00000100:00100000:3.0:1788622821.025941:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691328:12345-0@lo:502: Request processed in 164us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.025948:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788622821.026054:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691328:0@lo:502: 00000040:00080000:1.0:1788622821.026276:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788622821.026337:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788622821.026363:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691456:0@lo:502: 00000100:00100000:1.0:1788622821.026397:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622821.026428:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e04c5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.026622:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691456 00000100:00100000:3.0:1788622821.026627:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691456 00000100:00100000:3.0:1788622821.026657:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788622821.026664:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691456:12345-0@lo:502: 00000100:00100000:3.0:1788622821.026808:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691456:12345-0@lo:502: Request processed in 144us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.026815:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788622821.027903:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691456:0@lo:502: 00000040:00080000:1.0:1788622821.028220:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788622821.028237:0:6652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788622821.031369:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622821.031384:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622821.031386:0:6674:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788622821.031394:0:6674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e1026d000 00000020:00000080:0.0:1788622821.031397:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788622821.031418:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622821.031421:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622821.031422:0:6674:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788622821.031425:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788622821.031598:0:6652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788622821.031624:0:6652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788622821.031679:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622821.031693:0:6652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622821.031781:0:6652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788622821.031785:0:6652:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff997e1026d000 10000000:01000000:1.0:1788622821.031789:0:6652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff997e1026d000 10000000:01000000:1.0:1788622821.031794:0:6652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788622821.031799:0:6652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e1026d000 from 1 10000000:01000000:1.0:1788622821.031802:0:6652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788622821.031844:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622821.031853:0:6652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622821.031864:0:6652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622821.031895:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691584:0@lo:101: 00000100:00100000:1.0:1788622821.031979:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622821.032056:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e04c5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.032519:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691584 00000100:00100000:3.0:1788622821.032528:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691584 00000100:00100000:3.0:1788622821.032584:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788622821.032601:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866691584:12345-0@lo:101: 00010000:00010000:3.0:1788622821.032614:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622821.032630:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d654d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.032655:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d654d expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.032667:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d654d expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.032677:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fb400, rc 0) 00000100:00100000:3.0:1788622821.032762:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691584:12345-0@lo:101: Request processed in 141us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.032769:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788622821.032883:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691584:0@lo:101: 00010000:00010000:2.0:1788622821.032900:0:6652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.032908:0:6652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.033007:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691712:0@lo:501: 00000100:00100000:2.0:1788622821.033050:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.033074:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275180 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.033208:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691712 00000100:00100000:3.0:1788622821.033213:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691712 00000100:00100000:3.0:1788622821.033244:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788622821.033251:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691712:12345-0@lo:501: 00000100:00100000:3.0:1788622821.033480:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691712:12345-0@lo:501: Request processed in 229us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.033487:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788622821.033648:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691712:0@lo:501: 00000100:00100000:2.0:1788622821.033684:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691840:0@lo:503: 00000100:00100000:2.0:1788622821.033722:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.033771:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275180 going to sleep for 11 seconds 00000100:00100000:1.0:1788622821.033857:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691840 00000100:00100000:1.0:1788622821.033862:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691840 00000100:00100000:1.0:1788622821.033889:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788622821.033897:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691840:12345-0@lo:503: 00000100:00100000:1.0:1788622821.034176:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691840:12345-0@lo:503: Request processed in 279us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622821.034184:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788622821.034339:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691840:0@lo:503: 00000040:00080000:2.0:1788622821.034640:0:6652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788622821.034706:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691968:0@lo:502: 00000100:00100000:2.0:1788622821.034781:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.034808:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275180 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.034866:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866691968 00000100:00100000:3.0:1788622821.034871:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866691968 00000100:00100000:3.0:1788622821.034901:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788622821.034908:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691968:12345-0@lo:502: 00000100:00100000:3.0:1788622821.035118:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866691968:12345-0@lo:502: Request processed in 210us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.035135:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788622821.035275:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866691968:0@lo:502: 00000040:00080000:2.0:1788622821.035543:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788622821.035595:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788622821.035630:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788622821.035677:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788622821.035715:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788622821.035805:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788622821.035844:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788622821.035876:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788622821.035938:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788622821.035971:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788622821.036002:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788622821.036309:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788622821.036366:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788622821.036401:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788622821.036473:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788622821.039550:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788622821.039611:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788622821.039694:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788622821.039729:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788622821.039802:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788622821.039866:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788622821.039902:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788622821.039936:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788622821.039981:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788622821.040016:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788622821.040079:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788622821.040129:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788622821.040164:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788622821.040218:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866692096:0@lo:502: 00000100:00100000:2.0:1788622821.040299:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.040369:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275180 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.040842:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692096 00000100:00100000:3.0:1788622821.040852:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692096 00000100:00100000:3.0:1788622821.040903:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788622821.040912:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866692096:12345-0@lo:502: 00000100:00100000:3.0:1788622821.041187:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866692096:12345-0@lo:502: Request processed in 274us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.041194:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788622821.041299:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866692096:0@lo:502: 00000040:00080000:0.0:1788622821.041408:0:6652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788622821.041420:0:6652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788622821.047081:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788622821.047102:0:6675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff997e06550000) 00000020:00000080:3.0:1788622821.047127:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788622821.047210:0:6675:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e1026d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788622821.047214:0:6675:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e1026d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788622821.047217:0:6675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e1026d000 3 00010000:00080000:3.0:1788622821.047248:0:6675:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997d04f0b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.119@tcp at head 00010000:00010000:3.0:1788622821.053626:0:6675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788622821.053996:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788622821.054167:0:6675:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788622821.054182:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xef842f43731d6562 00000100:00080000:3.0:1788622821.054195:0:6675:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788622821.054203:0:6675:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff997d04f0b000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788622821.054244:0:6675:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a20f100 x1875506866692224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788622821.054302:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875506866692224:0@lo:38: 00000100:00100000:2.0:1788622821.054384:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622821.054495:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692224 00000100:00100000:1.0:1788622821.054503:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692224 00000100:00100000:1.0:1788622821.054540:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788622821.054548:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875506866692224:12345-0@lo:38: 00010000:00080000:1.0:1788622821.054572:0:5811:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:1.0:1788622821.054607:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xef842f43731d6569 00000004:00100000:1.0:1788622821.054623:0:5811:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788622821.054654:0:5811:0:(import.c:65:import_set_state_nolock()) ffff997e39a1a000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788622821.054713:0:6675:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788622821.054829:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866692352:0@lo:400: 00000100:00100000:3.0:1788622821.054867:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622821.054928:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866692480:0@lo:400: 00000100:00100000:3.0:1788622821.054955:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622821.054985:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692352 00000100:00100000:3.0:1788622821.054989:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692352 00000100:00100000:3.0:1788622821.055158:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788622821.055166:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3281:x1875506866692352:12345-0@lo:400: 00000100:00100000:3.0:1788622821.055206:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3281:x1875506866692352:12345-0@lo:400: Request processed in 42us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.055213:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788622821.055247:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788622821.055255:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788622821.055421:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866692352:0@lo:400: 00000100:00100000:0.0:1788622821.058254:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788622821.058278:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692480 00000100:00100000:0.0:1788622821.058287:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692480 00000100:00100000:0.0:1788622821.058335:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788622821.058347:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788622821.058357:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866692480:12345-0@lo:400: 00000100:00100000:0.0:1788622821.058458:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866692480:12345-0@lo:400: Request processed in 102us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622821.058465:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788622821.058564:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e3a20df80 x1875506866692480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622821.058579:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866692480:0@lo:400: 00000100:00100000:1.0:1788622821.061947:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875506866692224:12345-0@lo:38: Request processed in 7385us (7548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622821.061964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788622821.062180:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e3a20f100 x1875506866692224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788622831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622821.062193:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788622821.062205:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788622821.062215:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788622821.062220:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788622821.062223:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d04f0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788622821.062230:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875506866692224:0@lo:38: 00000040:00080000:1.0:1788622821.063452:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788622821.063963:0:6652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788622821.063989:0:6652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788622821.064011:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.064032:0:6652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788622821.064086:0:6652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788622821.064088:0:6652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788622821.064089:0:6652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788622821.064090:0:6652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788622821.064092:0:6652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788622821.064093:0:6652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788622821.064094:0:6652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788622821.064096:0:6652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788622821.064097:0:6652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788622821.064099:0:6652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788622821.064100:0:6652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788622821.064104:0:6652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788622821.064108:0:6652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788622821.064115:0:6652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788622821.064116:0:6652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788622821.064117:0:6652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788622821.064118:0:6652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788622821.064119:0:6652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788622821.064120:0:6652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788622821.064120:0:6652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788622821.064121:0:6652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788622821.064122:0:6652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788622821.064123:0:6652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788622821.064392:0:6652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788622821.064415:0:6652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866692608:0@lo:253: 00000100:00100000:0.0:1788622821.064485:0:6652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622821.064522:0:6652:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36c036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.065197:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692608 00000100:00100000:2.0:1788622821.065204:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692608 00000100:00100000:2.0:1788622821.065249:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788622821.065258:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6652:x1875506866692608:12345-0@lo:253: 20000000:01000000:2.0:1788622821.065286:0:5803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788622821.065301:0:5803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788622821.091937:0:5803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788622821.091953:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788622821.092014:0:5825:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788622821.092028:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788622821.092057:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.092083:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d64c1 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.092092:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.092148:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d64c1 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622821.092165:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d64c1 expref: 13 pid: 5803 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622821.092182:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5825:1875506866692736:0@lo:104: 00000100:00100000:0.0:1788622821.092261:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622821.092337:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36c03480 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.092531:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692736 00000100:00100000:3.0:1788622821.092539:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692736 00000100:00100000:3.0:1788622821.092593:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788622821.092603:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5825:x1875506866692736:12345-0@lo:104: 00010000:00010000:3.0:1788622821.092614:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092672:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788622821.092677:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5825:x1875506866692736:12345-0@lo:104: Request processed in 77us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.092697:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788622821.092735:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5825:1875506866692736:0@lo:104: 00010000:00010000:3.0:1788622821.092771:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092788:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788622821.092794:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092801:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00031400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622821.092804:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092813:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622821.092820:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622821.092826:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788622821.092853:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092860:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622821.092876:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092883:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d64c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64c8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.092913:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622821.092914:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622821.092916:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622821.092939:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866692864:0@lo:103: 00000100:00100000:3.0:1788622821.092974:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622821.093013:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692864 00000100:00100000:3.0:1788622821.093138:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692864 00010000:00010000:3.0:1788622821.093160:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d64c1 expref: 14 pid: 5803 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622821.093191:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788622821.093198:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e10329c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3279:x1875506866692864:12345-0@lo:103: 00010000:00010000:3.0:1788622821.093209:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622821.093214:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d64c1 expref: 14 pid: 5803 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093224:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d64c1 expref: 14 pid: 5803 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093238:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bacc00/0xef842f43731d64c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d64c1 expref: 14 pid: 5803 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093250:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093258:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788622821.093271:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002428039s 00010000:00010000:3.0:1788622821.093282:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093290:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093296:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093302:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093307:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00031200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788622821.093311:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093329:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093344:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093354:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622821.093384:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e10329c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3279:x1875506866692864:12345-0@lo:103: Request processed in 187us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.093391:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788622821.093433:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093442:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.093457:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00031200/0xef842f43731d6570 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622821.093485:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866692864:0@lo:103: 00000100:00100000:1.0:1788622821.110433:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:6652:x1875506866692608:12345-0@lo:253: Request processed in 45163us (45935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622821.110449:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788622821.110538:0:6652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6652:1875506866692608:0@lo:253: 10000000:01000000:0.0:1788622821.110554:0:6652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788622821.110557:0:6652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788622821.110559:0:6652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788622821.110560:0:6652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788622821.110561:0:6652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788622821.110562:0:6652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788622821.110563:0:6652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788622821.110565:0:6652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788622821.110567:0:6652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788622821.110568:0:6652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788622821.110569:0:6652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788622821.110570:0:6652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788622821.110584:0:6652:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788622821.116466:0:6652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788622821.116694:0:6652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788622821.116944:0:6652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788622821.117161:0:6652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788622821.117388:0:6652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788622821.117647:0:6652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788622821.120594:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788622821.294378:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788622821.443660:0:6652:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788622821.443668:0:6652:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788622821.443699:0:6652:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788622821.443791:0:6652:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788622821.443810:0:6652:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788622821.443843:0:6652:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1788622821.508024:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788622821.508035:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e0835b000 from 21 10000000:01000000:2.0:1788622821.508043:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788622821.508100:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.508113:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.508363:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.508391:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866692992:0@lo:101: 00000100:00100000:2.0:1788622821.508467:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.508536:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.508739:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866692992 00000100:00100000:3.0:1788622821.508769:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866692992 00000100:00100000:3.0:1788622821.508823:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788622821.508833:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866692992:12345-0@lo:101: 00010000:00010000:3.0:1788622821.508847:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622821.508861:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6577 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.508888:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6577 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.508902:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6577 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622821.508913:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fbc00, rc 0) 00000100:00100000:3.0:1788622821.508974:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866692992:12345-0@lo:101: Request processed in 143us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.508981:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788622821.509256:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866692992:0@lo:101: 00010000:00010000:2.0:1788622821.509272:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.509282:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.509359:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693120:0@lo:501: 00000100:00100000:2.0:1788622821.509397:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.509428:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.509590:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693120 00000100:00100000:3.0:1788622821.509595:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693120 00000100:00100000:3.0:1788622821.509624:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788622821.509631:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866693120:12345-0@lo:501: 00000100:00100000:3.0:1788622821.510057:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866693120:12345-0@lo:501: Request processed in 425us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.510065:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788622821.510217:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693120:0@lo:501: 00000100:00100000:2.0:1788622821.510251:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693248:0@lo:503: 00000100:00100000:2.0:1788622821.510292:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.510333:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622821.510387:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693248 00000100:00100000:3.0:1788622821.510393:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693248 00000100:00100000:3.0:1788622821.510460:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788622821.510468:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866693248:12345-0@lo:503: 00000100:00100000:3.0:1788622821.510667:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866693248:12345-0@lo:503: Request processed in 200us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622821.510673:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788622821.510762:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693248:0@lo:503: 00000100:00100000:1.0:1788622821.513299:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6681:1875506866693376:0@lo:502: 00000100:00100000:1.0:1788622821.513400:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622821.513447:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d070013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.513505:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693376 00000100:00100000:2.0:1788622821.513512:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693376 00000100:00100000:2.0:1788622821.513547:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788622821.513555:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6681:x1875506866693376:12345-0@lo:502: 00000100:00100000:2.0:1788622821.513821:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6681:x1875506866693376:12345-0@lo:502: Request processed in 265us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.513829:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788622821.513984:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6681:1875506866693376:0@lo:502: 00000100:00100000:1.0:1788622821.514113:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6681:1875506866693504:0@lo:502: 00000100:00100000:1.0:1788622821.514150:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622821.514177:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d070013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.514231:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693504 00000100:00100000:2.0:1788622821.514237:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693504 00000100:00100000:2.0:1788622821.514304:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788622821.514322:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6681:x1875506866693504:12345-0@lo:502: 00000100:00100000:2.0:1788622821.514473:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:6681:x1875506866693504:12345-0@lo:502: Request processed in 161us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.514480:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788622821.517781:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6681:1875506866693504:0@lo:502: 00000040:00080000:1.0:1788622821.517838:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788622821.518035:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788622821.518057:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788622821.518069:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518095:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622821.518107:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788622821.518110:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e0835b000 from 4 10000000:01000000:2.0:1788622821.518113:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788622821.518152:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518159:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518169:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.518189:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693632:0@lo:101: 00000100:00100000:2.0:1788622821.518253:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.518291:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.518322:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693632 00000100:00100000:2.0:1788622821.518330:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693632 00000100:00100000:2.0:1788622821.518386:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788622821.518395:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866693632:12345-0@lo:101: 00010000:00010000:2.0:1788622821.518409:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622821.518422:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6585 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518445:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6585 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518470:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6585 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518479:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bace00, rc 0) 00000100:00100000:2.0:1788622821.518518:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866693632:12345-0@lo:101: Request processed in 124us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.518525:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788622821.518561:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693632:0@lo:101: 00010000:00010000:2.0:1788622821.518573:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518582:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.518622:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693760:0@lo:256: 00000100:00100000:2.0:1788622821.518651:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.518664:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.518675:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693760 00000100:00100000:2.0:1788622821.518678:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693760 00000100:00100000:2.0:1788622821.518693:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788622821.518698:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866693760:12345-0@lo:256: 20000000:01000000:2.0:1788622821.518711:0:5803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788622821.518730:0:5803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788622821.518734:0:5803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788622821.518840:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866693760:12345-0@lo:256: Request processed in 140us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.518847:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788622821.518880:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693760:0@lo:256: 10000000:01000000:2.0:1788622821.518914:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788622821.518918:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518926:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622821.518933:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788622821.518935:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788622821.518937:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788622821.518952:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518958:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.518964:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.518974:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693888:0@lo:101: 00000100:00100000:2.0:1788622821.518997:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.519008:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.519018:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866693888 00000100:00100000:2.0:1788622821.519021:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866693888 00000100:00100000:2.0:1788622821.519037:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788622821.519043:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866693888:12345-0@lo:101: 00010000:00010000:2.0:1788622821.519049:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622821.519057:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6593 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.519078:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6593 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.519086:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6593 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.519093:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788622821.519119:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866693888:12345-0@lo:101: Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.519125:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788622821.519151:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866693888:0@lo:101: 00010000:00010000:2.0:1788622821.519161:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.519168:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.519208:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694016:0@lo:501: 00000100:00100000:2.0:1788622821.519229:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.519241:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.519251:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694016 00000100:00100000:2.0:1788622821.519254:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694016 00000100:00100000:2.0:1788622821.519269:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788622821.519273:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866694016:12345-0@lo:501: 00000100:00100000:2.0:1788622821.519834:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866694016:12345-0@lo:501: Request processed in 557us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.519842:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788622821.522917:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694016:0@lo:501: 00000100:00100000:2.0:1788622821.522991:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694144:0@lo:503: 00000100:00100000:2.0:1788622821.523077:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.523128:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788622821.523236:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694144 00000100:00100000:0.0:1788622821.523243:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694144 00000100:00100000:0.0:1788622821.523299:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788622821.523319:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866694144:12345-0@lo:503: 00000100:00100000:0.0:1788622821.528542:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866694144:12345-0@lo:503: Request processed in 5220us (5450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622821.528559:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788622821.528806:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694144:0@lo:503: 00000100:00100000:1.0:1788622821.529785:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6682:1875506866694272:0@lo:502: 00000100:00100000:1.0:1788622821.529856:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622821.529905:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d07001c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.530885:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694272 00000100:00100000:2.0:1788622821.530894:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694272 00000100:00100000:2.0:1788622821.530935:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788622821.530949:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:6682:x1875506866694272:12345-0@lo:502: 00000100:00100000:2.0:1788622821.531427:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:6682:x1875506866694272:12345-0@lo:502: Request processed in 481us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622821.531475:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6682:1875506866694272:0@lo:502: 00000020:01000000:0.0:1788622821.531510:0:6682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788622821.531518:0:6682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788622821.531525:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622821.531527:0:6682:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788622821.531534:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788622821.531538:0:6682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.119@tcp to nid 0x20000c0a8cc77 (192.168.204.119@tcp) 00000020:01000000:0.0:1788622821.531563:0:6682:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788622821.531567:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788622821.531598:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff997e0785b380) 00000020:00000080:0.0:1788622821.531622:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788622821.531629:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788622821.531719:0:6682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788622821.531727:0:6682:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788622821.531734:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d65a8 00010000:00080000:0.0:1788622821.531789:0:6682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997d04ee8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.119@tcp at head 00010000:00010000:0.0:1788622821.532021:0:6682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000100:00100000:2.0:1788622821.538015:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:01000000:3.0:1788622821.621601:0:6682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788622821.621627:0:6682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788622821.623511:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788622821.623702:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788622821.625924:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788622821.626064:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788622821.631350:0:6688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788622821.631361:0:6688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788622821.637721:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788622821.637777:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788622821.637829:0:6682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788622821.637860:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d65af 00000100:00080000:3.0:1788622821.637874:0:6682:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788622821.637882:0:6682:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff997d04ee8800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788622821.637930:0:6682:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a20df80 x1875506866694400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788622821.637958:0:6682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788622821.638404:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866694400:0@lo:8: 00000100:00100000:0.0:1788622821.638504:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.638677:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694400 00000100:00100000:2.0:1788622821.638686:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694400 00000100:00100000:2.0:1788622821.638726:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622821.638734:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875506866694400:12345-0@lo:8: 00010000:00080000:2.0:1788622821.638777:0:6655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1788622821.638812:0:6655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d65b6 00002000:00100000:2.0:1788622821.638851:0:6655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff997e3ccb8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788622821.638855:0:6655:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788622821.638859:0:6655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788622821.638998:0:6655:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788622821.639169:0:6655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788622821.639195:0:6655:0:(import.c:65:import_set_state_nolock()) ffff997e3ccb9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622821.639272:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875506866694400:12345-0@lo:8: Request processed in 537us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.639280:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788622821.640681:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a20df80 x1875506866694400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788622831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622821.640698:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788622821.640710:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788622821.640719:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788622821.641159:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788622821.641166:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d04ee8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788622821.641196:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788622821.641205:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866694400:0@lo:8: 00000004:00080000:2.0:1788622821.641272:0:6688:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788622821.641437:0:6688:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 145596693505ns, next at 0ns, rc = 0 00000020:01000000:3.0:1788622821.641499:0:6682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622821.641508:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622821.641510:0:6682:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788622821.641512:0:6682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788622821.641517:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622821.641518:0:6682:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788622821.641521:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788622821.641523:0:6682:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788622821.641565:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6682:1875506866694528:0@lo:502: 00000100:00100000:3.0:1788622821.641643:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622821.641686:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.644254:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694528 00000100:00100000:2.0:1788622821.644273:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694528 00000100:00100000:2.0:1788622821.644338:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788622821.644349:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:6682:x1875506866694528:12345-0@lo:502: 00000100:00100000:2.0:1788622821.644606:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:6682:x1875506866694528:12345-0@lo:502: Request processed in 257us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.644613:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788622821.647858:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:6682:1875506866694528:0@lo:502: 00000020:01000000:2.0:1788622821.647913:0:6682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788622821.647922:0:6682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622821.647924:0:6682:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788622821.647931:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788622821.648432:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788622821.648453:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788622821.648466:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.648479:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622821.648490:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788622821.648493:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff997e06120000 from 1 10000000:01000000:2.0:1788622821.648496:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788622821.648540:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.648557:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.648566:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.648588:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694656:0@lo:101: 00000100:00100000:2.0:1788622821.648652:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.648697:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.648718:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694656 00000100:00100000:2.0:1788622821.648724:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694656 00000100:00100000:2.0:1788622821.650844:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788622821.650869:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866694656:12345-0@lo:101: 00010000:00010000:2.0:1788622821.650891:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622821.650915:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d65bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.650957:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d65bd expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.650973:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d65bd expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.650984:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac600, rc 0) 00000100:00100000:2.0:1788622821.651068:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866694656:12345-0@lo:101: Request processed in 210us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.651074:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788622821.651499:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694656:0@lo:101: 00010000:00010000:2.0:1788622821.651527:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.651537:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622821.651609:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694784:0@lo:501: 00000100:00100000:2.0:1788622821.651647:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.651675:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.651692:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694784 00000100:00100000:2.0:1788622821.651698:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694784 00000100:00100000:2.0:1788622821.651723:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788622821.651729:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866694784:12345-0@lo:501: 00000100:00100000:2.0:1788622821.651949:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866694784:12345-0@lo:501: Request processed in 218us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788622821.651957:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788622821.651991:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866694784:0@lo:501: 10000000:01000000:2.0:1788622821.652013:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788622821.652020:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622821.652029:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788622821.732986:0:6689:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788622821.733029:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695040:0@lo:7: 00000100:00100000:2.0:1788622821.733115:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.733174:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103df3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788622821.733191:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788622821.733227:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866694912:0@lo:13: 00000100:00100000:2.0:1788622821.733253:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.735608:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695040 00000100:00100000:2.0:1788622821.735624:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695040 00000100:00100000:2.0:1788622821.735701:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622821.735712:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6689:x1875506866695040:12345-0@lo:7: 00000100:00100000:2.0:1788622821.744800:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866694912 00000100:00100000:2.0:1788622821.744812:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866694912 00000100:00100000:2.0:1788622821.744863:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622821.744872:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875506866694912:12345-0@lo:13: 00002000:00000024:2.0:1788622821.745022:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1788622821.745106:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875506866694912:12345-0@lo:13: Request processed in 234us (11851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.745113:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788622821.745133:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788622821.745184:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978e680 x1875506866694912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622821.745204:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866694912:0@lo:13: 00002000:00080000:2.0:1788622821.757197:0:6657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788622821.757209:0:6657:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788622821.758476:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6689:x1875506866695040:12345-0@lo:7: Request processed in 22756us (25351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622821.758491:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788622821.758701:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978f100 x1875506866695040/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788622837 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622821.758718:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695040:0@lo:7: 00000004:00080000:2.0:1788622821.758770:0:6689:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788622821.758826:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695168:0@lo:5: 00000100:00100000:2.0:1788622821.758869:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.759113:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.759230:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695168 00000100:00100000:2.0:1788622821.759237:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695168 00000100:00100000:2.0:1788622821.759496:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788622821.759506:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6689:x1875506866695168:12345-0@lo:5: 00002000:00080000:2.0:1788622821.759535:0:6655:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788622821.759538:0:6655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788622821.760010:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6689:x1875506866695168:12345-0@lo:5: Request processed in 506us (1140us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788622821.760017:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788622821.760070:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978f100 x1875506866695168/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788622837 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622821.760082:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695168:0@lo:5: 00000004:00080000:2.0:1788622821.760093:0:6689:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788622821.760123:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695296:0@lo:700: 00000100:00100000:2.0:1788622821.760153:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.760173:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.760193:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695296 00000100:00100000:2.0:1788622821.760198:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695296 00000100:00100000:2.0:1788622821.760232:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622821.760241:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6689:x1875506866695296:12345-0@lo:700: 00000100:00100000:2.0:1788622821.760286:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6663:1875506866695424:0@lo:700: 00000100:00100000:2.0:1788622821.760326:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622821.760350:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622821.760372:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695424 00000100:00100000:2.0:1788622821.760376:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695424 00000100:00100000:2.0:1788622821.760419:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622821.760425:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6663:x1875506866695424:12345-0@lo:700: 00000100:00080000:2.0:1788622821.760938:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:1.0:1788622821.874288:0:5816:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788622821.887876:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6663:x1875506866695424:12345-0@lo:700: Request processed in 127438us (127536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622821.887899:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788622821.887964:0:6663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978dc00 x1875506866695424/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788622837 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622821.887988:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6663:1875506866695424:0@lo:700: 40000000:02000000:1.0:1788622821.888155:0:6663:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788622822.026645:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788622822.026666:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788622822.026906:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6689:x1875506866695296:12345-0@lo:700: Request processed in 266662us (266747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622822.026919:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788622822.027129:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978c000 x1875506866695296/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788622837 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622822.027141:0:6689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788622822.027158:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695296:0@lo:700: 00000004:02000040:3.0:1788622822.087677:0:6689:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788622822.092174:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695552:0@lo:5: 00000100:00100000:3.0:1788622822.092389:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622822.092452:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622822.092511:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695552 00000100:00100000:2.0:1788622822.092519:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695552 00000100:00100000:2.0:1788622822.092651:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788622822.092662:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6689:x1875506866695552:12345-0@lo:5: 00002000:00080000:3.0:1788622822.101794:0:6655:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788622822.101815:0:6655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788622822.108487:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6689:x1875506866695552:12345-0@lo:5: Request processed in 15815us (16085us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788622822.108522:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788622822.111228:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a20c700 x1875506866695552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788622838 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622822.111262:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6689:1875506866695552:0@lo:5: 00000004:00080000:0.0:1788622822.111279:0:6689:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788622822.316002:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622823.340776:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622824.365221:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622825.389125:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622826.412061:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622827.063280:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866695680:0@lo:400: 00000100:00100000:3.0:1788622827.063363:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622827.063416:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866696192:0@lo:400: 00000100:00100000:3.0:1788622827.063461:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622827.063493:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788622827.063499:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866696064:0@lo:400: 00000100:00100000:3.0:1788622827.063531:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622827.063601:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866695808:0@lo:13: 00000100:00100000:3.0:1788622827.063626:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622827.063645:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622827.063650:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866695936:0@lo:400: 00000100:00100000:3.0:1788622827.063668:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622827.063823:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696064 00000100:00100000:3.0:1788622827.063833:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696064 00000100:00100000:3.0:1788622827.063882:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695936 00000100:00100000:3.0:1788622827.063885:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695936 00000100:00100000:3.0:1788622827.063904:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788622827.063912:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866696064:12345-0@lo:400: 00000100:00100000:3.0:1788622827.063961:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866696064:12345-0@lo:400: Request processed in 49us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622827.063967:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788622827.063983:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788622827.063988:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866695936:12345-0@lo:400: 00000100:00100000:3.0:1788622827.064017:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866695936:12345-0@lo:400: Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622827.064023:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788622827.064067:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a20f480 x1875506866696064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622827.064080:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866696064:0@lo:400: 00010000:00080000:3.0:1788622827.064120:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a20c000 x1875506866695936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622827.064130:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866695936:0@lo:400: 00000100:00100000:2.0:1788622827.065047:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695680 00000100:00100000:2.0:1788622827.065060:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695680 00000100:00100000:2.0:1788622827.065106:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788622827.065115:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3281:x1875506866695680:12345-0@lo:400: 00000100:00100000:2.0:1788622827.065178:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3281:x1875506866695680:12345-0@lo:400: Request processed in 65us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622827.065185:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788622827.068301:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866695680:0@lo:400: 00000100:00080000:3.0:1788622827.069822:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622827.069864:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866695808 00000100:00100000:3.0:1788622827.069878:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866695808 00000100:00100000:3.0:1788622827.069952:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788622827.069963:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866695808:12345-0@lo:13: 00002000:00000024:3.0:1788622827.070005:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622827.070090:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866695808:12345-0@lo:13: Request processed in 130us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622827.070098:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788622827.070143:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e0612c700 x1875506866695808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622827.070166:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866695808:0@lo:13: 00000100:00080000:3.0:1788622827.070197:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622827.070945:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696192 00000100:00100000:2.0:1788622827.070955:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696192 00000100:00100000:2.0:1788622827.071016:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622827.071024:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866696192:12345-0@lo:400: 00000100:00100000:2.0:1788622827.071080:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866696192:12345-0@lo:400: Request processed in 57us (7618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622827.071086:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788622827.074027:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a20d180 x1875506866696192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622827.074051:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866696192:0@lo:400: 00000001:00080000:3.0:1788622827.183881:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788622827.441527:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622828.463641:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788622828.907571:0:7026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788622829.484042:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622830.512058:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622831.532018:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622832.173269:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866696448:0@lo:13: 00000100:00100000:1.0:1788622832.173349:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622832.173796:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866696320:0@lo:400: 00000100:00100000:0.0:1788622832.173846:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622832.174160:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696448 00000100:00100000:0.0:1788622832.174169:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696448 00000100:00100000:0.0:1788622832.174222:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788622832.174232:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866696448:12345-0@lo:13: 00002000:00000024:0.0:1788622832.174285:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788622832.175267:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788622832.175323:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696320 00000100:00100000:3.0:1788622832.175330:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696320 00000100:00100000:3.0:1788622832.175371:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788622832.175389:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866696320:12345-0@lo:400: 00000100:00100000:3.0:1788622832.175455:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866696320:12345-0@lo:400: Request processed in 67us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622832.175462:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788622832.175541:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866696320:0@lo:400: 00000100:00100000:2.0:1788622832.178738:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866696576:0@lo:400: 00000100:00100000:2.0:1788622832.178834:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622832.178873:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788622832.178879:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866696704:0@lo:400: 00000100:00100000:2.0:1788622832.178902:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622832.178934:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696576 00000100:00100000:2.0:1788622832.178941:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696576 00000100:00100000:2.0:1788622832.178984:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696704 00000100:00100000:2.0:1788622832.178987:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696704 00000100:00100000:2.0:1788622832.179016:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788622832.179025:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866696576:12345-0@lo:400: 00000100:00100000:2.0:1788622832.179075:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866696576:12345-0@lo:400: Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622832.179083:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788622832.179098:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788622832.179117:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866696704:12345-0@lo:400: 00000100:00100000:2.0:1788622832.179143:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866696704:12345-0@lo:400: Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622832.179148:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788622832.179170:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788622832.179200:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978d880 x1875506866696704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622832.179214:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866696704:0@lo:400: 00010000:00080000:2.0:1788622832.179224:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978d180 x1875506866696576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622832.181811:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866696576:0@lo:400: 00000100:00100000:0.0:1788622832.184009:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866696448:12345-0@lo:13: Request processed in 9766us (10648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622832.184027:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788622832.192002:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a314000 x1875506866696448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622832.192020:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788622832.192056:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866696448:0@lo:13: 00010000:00010000:0.0:1788622832.568419:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622833.580933:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622834.604986:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622835.627935:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622836.653999:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622837.291975:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866696832:0@lo:400: 00000100:00100000:2.0:1788622837.292070:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622837.292124:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622837.292131:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866696960:0@lo:400: 00000100:00100000:2.0:1788622837.292158:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622837.292186:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866697088:0@lo:400: 00000100:00100000:2.0:1788622837.292208:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622837.292225:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788622837.292230:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866697216:0@lo:400: 00000100:00100000:2.0:1788622837.292253:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622837.292287:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696832 00000100:00100000:2.0:1788622837.292296:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696832 00000100:00100000:2.0:1788622837.292344:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788622837.292353:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866696832:12345-0@lo:400: 00000100:00100000:2.0:1788622837.292405:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866696832:12345-0@lo:400: Request processed in 53us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622837.292427:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788622837.292462:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866696960 00000100:00100000:2.0:1788622837.292466:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866696960 00000100:00100000:2.0:1788622837.292489:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697088 00000100:00100000:2.0:1788622837.292492:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697088 00000100:00100000:2.0:1788622837.292523:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788622837.292530:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866696960:12345-0@lo:400: 00000100:00100000:2.0:1788622837.292559:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866696960:12345-0@lo:400: Request processed in 30us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622837.292577:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788622837.292589:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788622837.292594:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866697088:12345-0@lo:400: 00000100:00100000:2.0:1788622837.292638:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866697088:12345-0@lo:400: Request processed in 44us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622837.292644:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788622837.292665:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697216 00000100:00100000:2.0:1788622837.292669:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697216 00000100:00100000:2.0:1788622837.292695:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622837.292702:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866697216:12345-0@lo:400: 00000100:00100000:2.0:1788622837.292731:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866697216:12345-0@lo:400: Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622837.292736:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788622837.292785:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788622837.292789:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788622837.293084:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978f480 x1875506866697216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622837.293099:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866697216:0@lo:400: 00010000:00080000:2.0:1788622837.293110:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978ed80 x1875506866697088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622837.293117:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866697088:0@lo:400: 00010000:00080000:2.0:1788622837.293148:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978d880 x1875506866696960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622837.293157:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866696960:0@lo:400: 00000100:00100000:2.0:1788622837.293166:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866696832:0@lo:400: 00000100:00100000:2.0:1788622837.295635:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866697344:0@lo:13: 00000100:00100000:2.0:1788622837.295713:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622837.295781:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697344 00000100:00100000:2.0:1788622837.295790:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697344 00000100:00100000:2.0:1788622837.295837:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788622837.295848:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866697344:12345-0@lo:13: 00002000:00000024:2.0:1788622837.295888:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622837.295933:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866697344:12345-0@lo:13: Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622837.295940:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788622837.295983:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3978d180 x1875506866697344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622837.296002:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866697344:0@lo:13: 00010000:00010000:1.0:1788622837.675970:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622838.699987:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622839.725352:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622840.752468:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788622841.377142:0:7595:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788622841.377149:0:7595:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788622841.377319:0:7595:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff997e3ccbd000 00000020:01000004:2.0:1788622841.377341:0:7595:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788622841.377356:0:7595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788622841.377387:0:7595:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff997e102319c0) 00000020:00000080:2.0:1788622841.377408:0:7595:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788622841.407107:0:7595:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788622841.408875:0:7595:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788622841.447124:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788622841.454117:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788622841.454157:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788622841.454220:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788622841.454249:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788622841.455041:0:7595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788622841.455058:0:7595:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788622841.455074:0:7595:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xef842f43731d65d2 00000020:01000004:3.0:1788622841.455085:0:7595:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788622841.455111:0:7595:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788622841.455115:0:7595:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788622841.455122:0:7595:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788622841.455153:0:7595:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788622841.455159:0:7595:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788622841.497249:0:7595:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788622841.497304:0:7595:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.119@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788622841.497308:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788622841.497310:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788622841.497312:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622841.497313:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622841.497318:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622841.497319:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622841.497321:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788622841.497322:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622841.497323:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622841.497325:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622841.497326:0:7595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788622841.497331:0:7595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788622841.497333:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788622841.497334:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788622841.497335:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622841.497336:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622841.497337:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622841.497338:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622841.497338:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788622841.497339:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622841.497340:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622841.497341:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622841.497342:0:7595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788622841.497392:0:7595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788622841.497419:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866697472:0@lo:253: 00000100:00100000:2.0:1788622841.498105:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.498214:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.498306:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697472 00000100:00100000:3.0:1788622841.498318:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697472 00000100:00100000:3.0:1788622841.498427:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788622841.498438:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:7595:x1875506866697472:12345-0@lo:253: 20000000:01000000:3.0:1788622841.498501:0:5803:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788622841.498509:0:5803:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788622841.498515:0:5803:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788622841.498533:0:5803:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788622841.500793:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788622841.501100:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788622841.501122:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788622841.501167:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788622841.501175:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788622841.501208:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788622841.501280:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788622841.501798:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788622841.501822:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.119@tcp 20000000:01000000:3.0:1788622841.501825:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.119@tcp (null) (null) (null) 00000040:00080000:3.0:1788622841.501858:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788622841.501865:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788622841.501908:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788622841.501915:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.119@tcp (null) (null) 00000040:00080000:3.0:1788622841.501956:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788622841.501966:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788622841.502891:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788622841.503038:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788622841.504318:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788622841.504343:0:5803:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.119@tcp 20000000:01000000:0.0:1788622841.504346:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.119@tcp (null) (null) (null) 00000040:00080000:0.0:1788622841.504375:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788622841.504382:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788622841.504406:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788622841.504413:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.119@tcp (null) (null) 00000040:00080000:0.0:1788622841.504436:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788622841.504559:0:5803:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788622841.504608:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788622841.504800:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788622841.504818:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788622841.504821:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788622841.504829:0:5803:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788622841.504830:0:5803:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788622841.504833:0:5803:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788622841.504849:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788622841.504852:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788622841.504901:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788622841.504904:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788622841.506321:0:7597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788622841.506429:0:7597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788622841.506605:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788622841.507253:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788622841.507305:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788622841.507366:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788622841.507403:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788622841.507406:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788622841.509293:0:7598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788622841.509391:0:7598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788622841.509841:0:7598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788622841.510355:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788622841.510408:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788622841.510876:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788622841.510893:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788622841.510896:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788622841.512193:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788622841.512555:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788622841.512605:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788622841.512964:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788622841.513053:0:5803:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788622841.513056:0:5803:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788622841.514379:0:7600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788622841.515112:0:7600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788622841.515231:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788622841.517228:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788622841.517287:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788622841.517324:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1788622841.517345:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788622841.517370:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517393:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6523 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517401:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517407:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6577 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517413:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6593 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517418:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d65bd expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517547:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.517603:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d65bd expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.518312:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d65bd expref: 16 pid: 5804 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.518339:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697600:0@lo:104: 00000100:00100000:0.0:1788622841.518453:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788622841.518621:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6593 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.518644:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6593 expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.518653:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697728:0@lo:104: 00010000:00010000:0.0:1788622841.518856:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6577 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.518865:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6577 expref: 16 pid: 5801 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.518874:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697856:0@lo:104: 00010000:00010000:0.0:1788622841.518909:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.518918:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.518951:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697984:0@lo:104: 00010000:00010000:0.0:1788622841.519162:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6523 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.519171:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6523 expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.519179:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866698112:0@lo:104: 00000100:00100000:0.0:1788622841.519201:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de780 going to sleep for 11 seconds 00000100:00100000:2.0:1788622841.519890:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788622841.519932:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.520070:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.520194:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.520218:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697600 00000100:00100000:3.0:1788622841.520228:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697600 00000100:00100000:3.0:1788622841.520288:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697728 00000100:00100000:3.0:1788622841.520291:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697728 00000100:00100000:3.0:1788622841.520304:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697856 00000100:00100000:3.0:1788622841.520306:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697856 00000100:00100000:3.0:1788622841.520320:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788622841.520330:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e099e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:5803:x1875506866697600:12345-0@lo:104: 00010000:00010000:3.0:1788622841.520358:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520464:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788622841.520471:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e099e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:5803:x1875506866697600:12345-0@lo:104: Request processed in 142us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.520480:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788622841.520531:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788622841.520538:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:5803:x1875506866697728:12345-0@lo:104: 00010000:00010000:3.0:1788622841.520545:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520596:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788622841.520601:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:5803:x1875506866697728:12345-0@lo:104: Request processed in 65us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.520606:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788622841.520617:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788622841.520634:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866697856:12345-0@lo:104: 00010000:00010000:3.0:1788622841.520642:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520671:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788622841.520676:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866697856:12345-0@lo:104: Request processed in 53us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.520693:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788622841.520717:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788622841.520723:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520738:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622841.520772:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520783:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622841.520791:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622841.520798:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788622841.520841:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520847:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622841.520868:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520875:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bad000/0xef842f43731d65bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d65c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520895:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788622841.520898:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520904:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bac000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622841.520906:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520934:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622841.520941:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622841.520946:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788622841.520961:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.520967:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788622841.521096:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697600:0@lo:104: 00000100:00100000:0.0:1788622841.521107:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697728:0@lo:104: 00000100:00100000:0.0:1788622841.521113:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697856:0@lo:104: 00010000:00010000:1.0:1788622841.521270:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788622841.521470:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.521477:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.521485:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bacc00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:1.0:1788622841.521488:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.521495:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788622841.521502:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622841.521513:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788622841.521529:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.521534:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788622841.521552:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.521559:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d6577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d657e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.521572:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.521573:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.521575:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.521580:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.521581:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622841.522341:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.522354:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d659a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.522366:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622841.522368:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622841.522370:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622841.522406:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866698240:0@lo:103: 00000100:00100000:3.0:1788622841.522493:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.523302:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.523322:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866697984 00000100:00100000:2.0:1788622841.523332:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866697984 00000100:00100000:2.0:1788622841.523380:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698112 00000100:00100000:2.0:1788622841.523384:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698112 00000100:00100000:2.0:1788622841.523400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622841.523410:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:5803:x1875506866697984:12345-0@lo:104: 00010000:00010000:2.0:1788622841.523949:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.524166:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788622841.524174:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:5803:x1875506866697984:12345-0@lo:104: Request processed in 765us (3979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.524183:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622841.524210:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788622841.524219:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866698112:12345-0@lo:104: 00010000:00010000:2.0:1788622841.524231:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.524267:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788622841.524273:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5803:x1875506866698112:12345-0@lo:104: Request processed in 57us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.524278:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788622841.524307:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866698496:0@lo:103: 00000100:00100000:2.0:1788622841.524344:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622841.524471:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866697984:0@lo:104: 00000100:00100000:1.0:1788622841.524485:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5803:1875506866698112:0@lo:104: 00010000:00010000:1.0:1788622841.524527:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.524548:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788622841.524553:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.524560:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:1.0:1788622841.524576:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.524604:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788622841.524611:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622841.524617:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788622841.525214:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525223:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788622841.525247:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525255:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13735200/0xef842f43731d654d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6554 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525273:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788622841.525276:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525281:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad800 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:1.0:1788622841.525284:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525291:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788622841.525297:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622841.525310:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788622841.525328:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525334:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788622841.525338:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525344:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bad800/0xef842f43731d6523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d652a expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.525359:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.525361:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622841.525363:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622841.525657:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788622841.525669:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866698368:0@lo:103: 00000100:00100000:2.0:1788622841.525718:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.525876:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698240 00000100:00100000:0.0:1788622841.525884:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698240 00010000:00010000:0.0:1788622841.525934:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d65bd expref: 17 pid: 5804 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.525963:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698496 00000100:00100000:0.0:1788622841.525966:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698496 00010000:00010000:0.0:1788622841.525991:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6577 expref: 18 pid: 5801 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.526007:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788622841.526015:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3279:x1875506866698240:12345-0@lo:103: 00010000:00010000:0.0:1788622841.526031:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622841.526038:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d65bd expref: 18 pid: 5804 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.526060:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d65bd expref: 18 pid: 5804 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.526078:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac600/0xef842f43731d65c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d65bd expref: 18 pid: 5804 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.526095:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622841.526130:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3279:x1875506866698240:12345-0@lo:103: Request processed in 117us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.526137:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788622841.526154:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788622841.526161:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3280:x1875506866698496:12345-0@lo:103: 00010000:00010000:0.0:1788622841.526169:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622841.526172:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6577 expref: 16 pid: 5801 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.526180:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6577 expref: 16 pid: 5801 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.526189:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fbc00/0xef842f43731d657e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6577 expref: 16 pid: 5801 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.526198:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622841.526220:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:3280:x1875506866698496:12345-0@lo:103: Request processed in 61us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.526226:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788622841.526660:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866698496:0@lo:103: 00010000:00010000:2.0:1788622841.526873:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622841.527059:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866698624:0@lo:103: 00000100:00100000:3.0:1788622841.527106:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.527217:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622841.527224:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866698752:0@lo:103: 00000100:00100000:3.0:1788622841.527247:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.527303:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698368 00000100:00100000:0.0:1788622841.527309:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698368 00010000:00010000:0.0:1788622841.527347:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6593 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.527380:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698624 00000100:00100000:0.0:1788622841.527383:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698624 00010000:00010000:0.0:1788622841.527396:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.527408:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788622841.527415:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3280:x1875506866698368:12345-0@lo:103: 00010000:00010000:0.0:1788622841.527426:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622841.527431:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6593 expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.527453:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6593 expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622841.527546:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788622841.527557:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788622841.527848:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622841.527856:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866698624:12345-0@lo:103: 00010000:00010000:2.0:1788622841.527877:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622841.527883:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.528120:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.528139:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb400/0xef842f43731d6554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d654d expref: 16 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.528159:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622841.528208:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:3278:x1875506866698624:12345-0@lo:103: Request processed in 353us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.528216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788622841.528483:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866698624:0@lo:103: 00000100:00100000:3.0:1788622841.528529:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698752 00000100:00100000:3.0:1788622841.528535:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698752 00010000:00010000:3.0:1788622841.528556:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6523 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622841.528576:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788622841.528582:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:3278:x1875506866698752:12345-0@lo:103: 00010000:00010000:3.0:1788622841.528590:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622841.528595:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6523 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.528604:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6523 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.528614:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fac00/0xef842f43731d652a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6523 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.528873:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622841.528909:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3278:x1875506866698752:12345-0@lo:103: Request processed in 327us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.528916:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788622841.528956:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866698752:0@lo:103: 00000100:00100000:3.0:1788622841.528996:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866698240:0@lo:103: 00010000:00010000:0.0:1788622841.529207:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac200/0xef842f43731d659a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6593 expref: 13 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529221:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529230:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529250:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529258:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529278:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529285:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529292:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00031200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622841.529297:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529307:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529335:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.529355:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622841.529408:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3280:x1875506866698368:12345-0@lo:103: Request processed in 1992us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.529415:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788622841.529590:0:5803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.529600:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.529607:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00031200/0xef842f43731d65d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788622841.529847:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788622841.530099:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866698368:0@lo:103: 00000100:00100000:2.0:1788622841.603983:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:7595:x1875506866697472:12345-0@lo:253: Request processed in 105532us (105866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.604003:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788622841.604426:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866697472:0@lo:253: 10000000:01000000:0.0:1788622841.604450:0:7595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788622841.604454:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788622841.604456:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788622841.604458:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788622841.604459:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788622841.604460:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788622841.604462:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788622841.604463:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788622841.604465:0:7595:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788622841.604467:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788622841.604502:0:7595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788622841.604534:0:7595:0:(tgt_mount.c:101:server_register_mount()) register mount ffff997e3ccbd000 from lustre-OST0001 10000000:01000000:0.0:1788622841.604571:0:7595:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788622841.604574:0:7595:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788622841.604584:0:7595:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff997e06120000 local copy 10000000:01000000:0.0:1788622841.604590:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788622841.604645:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.604658:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.604669:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.604692:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866698880:0@lo:101: 00000100:00100000:0.0:1788622841.604782:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.604823:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de900 going to sleep for 11 seconds 00000100:00100000:2.0:1788622841.604895:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866698880 00000100:00100000:2.0:1788622841.604903:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866698880 00000100:00100000:2.0:1788622841.604979:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788622841.604998:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:7595:x1875506866698880:12345-0@lo:101: 00010000:00010000:2.0:1788622841.605013:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622841.605029:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bac200/0xef842f43731d65e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d65e0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.605070:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac200/0xef842f43731d65e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d65e0 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.605082:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bac200/0xef842f43731d65e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d65e0 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.605093:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788622841.605133:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866698880:12345-0@lo:101: Request processed in 138us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.605140:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788622841.605346:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866698880:0@lo:101: 00010000:00010000:0.0:1788622841.605362:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.605374:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.605507:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699008:0@lo:501: 00000100:00100000:0.0:1788622841.605539:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.605562:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de900 going to sleep for 11 seconds 00000100:00100000:2.0:1788622841.605616:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699008 00000100:00100000:2.0:1788622841.605620:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699008 00000100:00100000:2.0:1788622841.605640:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788622841.605646:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699008:12345-0@lo:501: 00000100:00100000:2.0:1788622841.605940:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699008:12345-0@lo:501: Request processed in 293us (399us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788622841.605948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788622841.606082:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699008:0@lo:501: 10000000:01000000:0.0:1788622841.606098:0:7595:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788622841.606134:0:7595:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788622841.606141:0:7595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.606150:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.606224:0:7595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.606248:0:7595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788622841.606280:0:7595:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff997e3ccbd000 10000000:01000000:0.0:1788622841.606286:0:7595:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788622841.606292:0:7595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788622841.606295:0:7595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788622841.606301:0:7595:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788622841.606304:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788622841.606330:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.606340:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.606349:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.606363:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699136:0@lo:101: 00000100:00100000:0.0:1788622841.606393:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788622841.606468:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788622841.606479:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.606500:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00031400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622841.606505:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.606514:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622841.606522:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622841.606528:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788622841.606553:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.606559:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622841.606586:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.606594:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e00031400/0xef842f43731d65e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xef842f43731d65e7 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.606612:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622841.606614:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622841.606616:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622841.606629:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866699264:0@lo:103: 00000100:00100000:3.0:1788622841.606663:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.606717:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699264 00000100:00100000:3.0:1788622841.606722:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699264 00000100:00100000:3.0:1788622841.606809:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788622841.606824:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3280:x1875506866699264:12345-0@lo:103: 00010000:00010000:3.0:1788622841.606839:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622841.606856:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac200/0xef842f43731d65e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d65e0 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.606872:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622841.606912:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:3280:x1875506866699264:12345-0@lo:103: Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.606918:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788622841.606973:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866699264:0@lo:103: 00000100:00100000:0.0:1788622841.607049:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622841.607209:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699136 00000100:00100000:1.0:1788622841.607214:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699136 00000100:00100000:2.0:1788622841.607330:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788622841.607340:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+11:7595:x1875506866699136:12345-0@lo:101: 00010000:00010000:2.0:1788622841.607351:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622841.607368:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d65ee expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.607403:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d65ee expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.607415:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d65ee expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.607423:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad800, rc 0) 00000100:00100000:2.0:1788622841.607465:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699136:12345-0@lo:101: Request processed in 127us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.607560:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699136:0@lo:101: 00010000:00010000:0.0:1788622841.607581:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.607589:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.607685:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699392:0@lo:501: 00000100:00100000:0.0:1788622841.607714:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.607737:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.607837:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699392 00000100:00100000:3.0:1788622841.607841:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699392 00000100:00100000:2.0:1788622841.607970:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788622841.608408:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788622841.608418:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699392:12345-0@lo:501: 00000100:00100000:3.0:1788622841.608736:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699392:12345-0@lo:501: Request processed in 320us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.608937:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699392:0@lo:501: 00000100:00100000:0.0:1788622841.608983:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699520:0@lo:503: 00000100:00100000:0.0:1788622841.609034:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.609065:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788622841.609380:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.609486:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699520 00000100:00100000:3.0:1788622841.609493:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699520 00000100:00100000:3.0:1788622841.609518:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788622841.609526:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699520:12345-0@lo:503: 00000100:00100000:3.0:1788622841.609723:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699520:12345-0@lo:503: Request processed in 197us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.609731:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788622841.610791:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699520:0@lo:503: 00000040:00080000:0.0:1788622841.611805:0:7595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788622841.611918:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699648:0@lo:502: 00000100:00100000:0.0:1788622841.612203:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.612256:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.612646:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699648 00000100:00100000:3.0:1788622841.612655:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699648 00000100:00100000:3.0:1788622841.612715:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788622841.612734:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699648:12345-0@lo:502: 00000100:00100000:3.0:1788622841.613230:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699648:12345-0@lo:502: Request processed in 496us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.613241:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788622841.613410:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699648:0@lo:502: 00000040:00080000:2.0:1788622841.614388:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788622841.614620:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788622841.614904:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788622841.615216:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788622841.615273:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788622841.615310:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788622841.615369:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699776:0@lo:502: 00000100:00100000:2.0:1788622841.615460:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.615521:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.615909:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699776 00000100:00100000:3.0:1788622841.615929:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699776 00000100:00100000:3.0:1788622841.616003:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788622841.616015:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699776:12345-0@lo:502: 00000100:00100000:3.0:1788622841.616299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699776:12345-0@lo:502: Request processed in 285us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.616307:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788622841.616476:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699776:0@lo:502: 00000040:00080000:2.0:1788622841.616613:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788622841.616641:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788622841.618459:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788622841.618473:0:7605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788622841.618482:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622841.618485:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788622841.618493:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788622841.618530:0:7605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff997e2f1ecd40) 00000020:00000080:3.0:1788622841.618562:0:7605:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788622841.618570:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788622841.618719:0:7605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e3ccbd000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788622841.618729:0:7605:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788622841.618827:0:7605:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xef842f43731d6603 00010000:00010000:3.0:1788622841.628780:0:7605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788622841.629259:0:7605:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788622841.632858:0:7605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788622841.633282:0:7605:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788622841.637489:0:7605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788622841.638401:0:7605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788622841.640192:0:7605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788622841.640212:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622841.640220:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622841.640222:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788622841.640226:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788622841.640231:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622841.640232:0:7605:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788622841.640235:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788622841.640237:0:7605:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788622841.640310:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622841.640313:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622841.640314:0:7605:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788622841.640318:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788622841.640429:0:7595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788622841.640473:0:7595:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788622841.640525:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.640550:0:7595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622841.640561:0:7595:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e3ccbd000 from 1 10000000:01000000:2.0:1788622841.640564:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788622841.640617:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.640626:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.640639:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622841.640671:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699904:0@lo:101: 00000100:00100000:2.0:1788622841.640782:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.640829:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866699904 00000100:00100000:2.0:1788622841.640835:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.640840:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866699904 00000100:00100000:3.0:1788622841.640900:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788622841.640913:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:7595:x1875506866699904:12345-0@lo:101: 00010000:00010000:3.0:1788622841.640941:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622841.640961:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d660a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.640993:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d660a expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.641009:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d660a expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.641021:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fac00, rc 0) 00000100:00100000:3.0:1788622841.641090:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866699904:12345-0@lo:101: Request processed in 180us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.641099:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788622841.641131:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866699904:0@lo:101: 00010000:00010000:2.0:1788622841.641151:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.641171:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622841.641296:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700032:0@lo:501: 00000100:00100000:2.0:1788622841.641325:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.641350:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.641718:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700032 00000100:00100000:3.0:1788622841.641734:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700032 00000100:00100000:3.0:1788622841.641813:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788622841.641822:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700032:12345-0@lo:501: 00000100:00100000:3.0:1788622841.642179:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700032:12345-0@lo:501: Request processed in 358us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.642187:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788622841.643803:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700032:0@lo:501: 00000100:00100000:2.0:1788622841.643874:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700160:0@lo:503: 00000100:00100000:2.0:1788622841.643965:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.644012:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.644093:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700160 00000100:00100000:3.0:1788622841.644100:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700160 00000100:00100000:3.0:1788622841.644164:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788622841.644174:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700160:12345-0@lo:503: 00000100:00100000:3.0:1788622841.644607:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700160:12345-0@lo:503: Request processed in 433us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.644630:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788622841.646886:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700160:0@lo:503: 00000040:00080000:3.0:1788622841.647389:0:7595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788622841.647505:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700288:0@lo:502: 00000100:00100000:3.0:1788622841.647697:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.647812:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06571180 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.648498:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700288 00000100:00100000:0.0:1788622841.648508:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700288 00000100:00100000:0.0:1788622841.648585:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788622841.648600:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700288:12345-0@lo:502: 00000100:00100000:0.0:1788622841.649099:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700288:12345-0@lo:502: Request processed in 501us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.649108:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788622841.649256:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700288:0@lo:502: 00000040:00080000:3.0:1788622841.650797:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788622841.650908:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788622841.650977:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700416:0@lo:502: 00000100:00100000:3.0:1788622841.651065:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.651116:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06571180 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.651203:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700416 00000100:00100000:0.0:1788622841.651220:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700416 00000100:00100000:0.0:1788622841.651286:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788622841.651296:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700416:12345-0@lo:502: 00000100:00100000:0.0:1788622841.651524:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700416:12345-0@lo:502: Request processed in 229us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.651533:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788622841.651697:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700416:0@lo:502: 00000040:00080000:2.0:1788622841.652033:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788622841.652104:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788622841.655208:0:7609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622841.655224:0:7609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622841.655227:0:7609:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788622841.655236:0:7609:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e3ccbd000 00000020:00000080:0.0:1788622841.655239:0:7609:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788622841.655259:0:7609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622841.655262:0:7609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622841.655263:0:7609:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788622841.655266:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788622841.655412:0:7595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788622841.655444:0:7595:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788622841.655472:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.655487:0:7595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622841.655542:0:7595:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788622841.655546:0:7595:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff997e3ccbd000 10000000:01000000:2.0:1788622841.655551:0:7595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff997e3ccbd000 10000000:01000000:2.0:1788622841.655556:0:7595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788622841.655563:0:7595:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e3ccbd000 from 1 10000000:01000000:2.0:1788622841.655566:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788622841.655676:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.655687:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.655704:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622841.655807:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700544:0@lo:101: 00000100:00100000:2.0:1788622841.656120:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.656240:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.656725:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700544 00000100:00100000:0.0:1788622841.656738:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700544 00000100:00100000:0.0:1788622841.656847:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788622841.656859:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866700544:12345-0@lo:101: 00010000:00010000:0.0:1788622841.656877:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622841.656898:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6618 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.656942:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6618 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.656956:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6618 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622841.656967:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e00031c00, rc 0) 00000100:00100000:0.0:1788622841.657061:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700544:12345-0@lo:101: Request processed in 204us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.657068:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788622841.657223:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700544:0@lo:101: 00010000:00010000:2.0:1788622841.657244:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.657258:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622841.657934:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700672:0@lo:501: 00000100:00100000:2.0:1788622841.657983:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.658020:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622841.659364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700672 00000100:00100000:3.0:1788622841.659380:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700672 00000100:00100000:3.0:1788622841.659457:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788622841.659495:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700672:12345-0@lo:501: 00000100:00100000:3.0:1788622841.660066:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700672:12345-0@lo:501: Request processed in 578us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622841.660075:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788622841.660252:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700672:0@lo:501: 00000100:00100000:2.0:1788622841.660314:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700800:0@lo:503: 00000100:00100000:2.0:1788622841.660375:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.660423:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.660671:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700800 00000100:00100000:0.0:1788622841.660678:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700800 00000100:00100000:0.0:1788622841.660761:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788622841.660771:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700800:12345-0@lo:503: 00000100:00100000:0.0:1788622841.661012:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700800:12345-0@lo:503: Request processed in 241us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.661021:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788622841.662571:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700800:0@lo:503: 00000040:00080000:3.0:1788622841.663265:0:7595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788622841.663372:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700928:0@lo:502: 00000100:00100000:3.0:1788622841.663470:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.663533:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06571e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.663657:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866700928 00000100:00100000:0.0:1788622841.663665:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866700928 00000100:00100000:0.0:1788622841.663763:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788622841.663775:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700928:12345-0@lo:502: 00000100:00100000:0.0:1788622841.664104:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866700928:12345-0@lo:502: Request processed in 331us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.664113:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788622841.664293:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866700928:0@lo:502: 00000040:00080000:2.0:1788622841.664794:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788622841.664869:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788622841.664908:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788622841.664973:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788622841.665012:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788622841.665077:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788622841.665115:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788622841.665150:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788622841.665212:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788622841.665249:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788622841.665279:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788622841.665328:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788622841.665387:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788622841.665424:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788622841.665475:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788622841.665505:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788622841.665534:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788622841.665572:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788622841.665606:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788622841.667895:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788622841.668264:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788622841.668306:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788622841.668333:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788622841.668375:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788622841.668405:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788622841.668431:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788622841.668503:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788622841.668536:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788622841.668562:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788622841.670976:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788622841.671129:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788622841.671169:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788622841.671205:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788622841.671291:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788622841.671329:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788622841.671380:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788622841.671419:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788622841.671493:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866701056:0@lo:502: 00000100:00100000:2.0:1788622841.674787:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622841.674866:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701056 00000100:00100000:0.0:1788622841.674880:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701056 00000100:00100000:2.0:1788622841.674902:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.674972:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788622841.674984:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866701056:12345-0@lo:502: 00000100:00100000:0.0:1788622841.675372:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866701056:12345-0@lo:502: Request processed in 390us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.675382:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788622841.675660:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866701056:0@lo:502: 00000040:00080000:2.0:1788622841.675846:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788622841.675867:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788622841.683393:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788622841.683421:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff997e078599c0) 00000020:00000080:0.0:1788622841.683449:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788622841.683545:0:7610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e3ccbd000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788622841.683566:0:7610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e3ccbd000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788622841.683570:0:7610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e3ccbd000 3 00010000:00080000:0.0:1788622841.686631:0:7610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e10367800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.119@tcp at head 00010000:00010000:1.0:1788622841.701566:0:7610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788622841.702121:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788622841.702174:0:7610:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788622841.702190:0:7610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xef842f43731d662d 00000100:00080000:1.0:1788622841.702205:0:7610:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788622841.702213:0:7610:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff997e10367800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:1.0:1788622841.702264:0:7610:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a314a80 x1875506866701184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788622841.702301:0:7610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788622841.702772:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866701312:0@lo:400: 00000100:00100000:2.0:1788622841.702877:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.702954:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866701440:0@lo:400: 00000100:00100000:2.0:1788622841.702982:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788622841.702989:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788622841.703002:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622841.703008:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866701568:0@lo:400: 00000100:00100000:2.0:1788622841.703034:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.703070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701312 00000100:00100000:2.0:1788622841.703079:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701312 00000100:00100000:2.0:1788622841.703123:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701440 00000100:00100000:2.0:1788622841.703126:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701440 00000100:00100000:2.0:1788622841.703160:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622841.703169:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866701312:12345-0@lo:400: 00000100:00080000:1.0:1788622841.703180:0:7611:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff997e3a317b80 x1875506866701696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622841.703209:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f600 going to sleep for 0 seconds 00000100:00100000:2.0:1788622841.703228:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866701312:12345-0@lo:400: Request processed in 59us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.703235:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622841.703251:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788622841.703258:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866701440:12345-0@lo:400: 00000100:00100000:2.0:1788622841.703296:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866701440:12345-0@lo:400: Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.703301:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788622841.703325:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701568 00000100:00100000:2.0:1788622841.703328:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701568 00000100:00100000:2.0:1788622841.703357:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788622841.703372:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866701568:12345-0@lo:400: 00000100:00100000:2.0:1788622841.703403:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866701568:12345-0@lo:400: Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.703409:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788622841.703430:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788622841.703435:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788622841.703467:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e37398000 x1875506866701312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622841.703483:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866701312:0@lo:400: 00000020:01000000:2.0:1788622841.703513:0:7595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788622841.703549:0:7595:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788622841.703569:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.703580:0:7595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788622841.703634:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788622841.703637:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788622841.703638:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622841.703640:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622841.703641:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622841.703643:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622841.703644:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788622841.703646:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622841.703647:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622841.703649:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622841.703650:0:7595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788622841.703656:0:7595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788622841.703658:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788622841.703660:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788622841.703661:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622841.703664:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622841.703665:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622841.703667:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622841.703667:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788622841.703668:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622841.703669:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622841.703670:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622841.703671:0:7595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788622841.703687:0:7595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788622841.703694:0:7595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866701824:0@lo:253: 00000100:00100000:2.0:1788622841.703731:0:7595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.703819:0:7595:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622841.703979:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866701184:0@lo:38: 00000100:00100000:0.0:1788622841.704018:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.704089:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701184 00000100:00100000:2.0:1788622841.704094:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701184 00000100:00100000:2.0:1788622841.704124:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788622841.704129:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1875506866701184:12345-0@lo:38: 00010000:00080000:2.0:1788622841.704150:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1788622841.704184:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xef842f43731d6634 00000004:00100000:2.0:1788622841.704202:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788622841.704237:0:5810:0:(import.c:65:import_set_state_nolock()) ffff997e37397800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622841.704277:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875506866701184:12345-0@lo:38: Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.704283:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788622841.704314:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a314a80 x1875506866701184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788622851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622841.704323:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788622841.704330:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788622841.704338:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788622841.704342:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788622841.704344:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e10367800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788622841.704359:0:3277:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000045229d07): req@ffff997e3a317b80 x1875506866701696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622841.704376:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866701184:0@lo:38: 00000100:00100000:2.0:1788622841.704422:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622841.704448:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701696 00000100:00100000:2.0:1788622841.704452:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701696 00000100:00100000:2.0:1788622841.704480:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622841.704486:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7611:x1875506866701696:12345-0@lo:901: 00000100:00100000:2.0:1788622841.706541:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7611:x1875506866701696:12345-0@lo:901: Request processed in 2042us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.706558:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788622841.706578:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e37399180 x1875506866701568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788622841.706599:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788622841.706633:0:7611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a317b80 x1875506866701696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788622857 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622841.706649:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7611:1875506866701696:0@lo:901: 00000100:00100000:1.0:1788622841.707770:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866701568:0@lo:400: 00010000:00080000:1.0:1788622841.707805:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3739b480 x1875506866701440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622841.707814:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866701440:0@lo:400: 00000100:00100000:2.0:1788622841.707884:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701824 00000100:00100000:2.0:1788622841.707894:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701824 00000100:00100000:2.0:1788622841.708005:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788622841.708016:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7595:x1875506866701824:12345-0@lo:253: 20000000:01000000:2.0:1788622841.708055:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788622841.708075:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1788622841.775406:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788622841.800094:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788622841.800119:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788622841.800193:0:5825:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788622841.800200:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788622841.800230:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.800253:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6585 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.800263:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.800323:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6585 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622841.800342:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6585 expref: 14 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622841.800360:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5825:1875506866701952:0@lo:104: 00000100:00100000:3.0:1788622841.800457:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622841.800535:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d06094e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788622841.800648:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866701952 00000100:00100000:2.0:1788622841.800659:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866701952 00000100:00100000:2.0:1788622841.800732:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788622841.800770:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5825:x1875506866701952:12345-0@lo:104: 00010000:00010000:2.0:1788622841.800788:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622841.801008:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5825:1875506866701952:0@lo:104: 00010000:00010000:3.0:1788622841.801034:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.801110:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788622841.801120:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:5825:x1875506866701952:12345-0@lo:104: Request processed in 377us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622841.801129:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788622841.801159:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622841.801167:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.801176:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622841.801180:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.801191:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622841.801199:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622841.801206:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622841.801252:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.801259:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622841.801280:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.801288:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bad400/0xef842f43731d6585 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d658c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622841.801319:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622841.801321:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622841.801323:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622841.801339:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866702080:0@lo:103: 00000100:00100000:2.0:1788622841.801381:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622841.802660:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702080 00000100:00100000:1.0:1788622841.802675:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702080 00010000:00010000:1.0:1788622841.802735:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6585 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622841.802797:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788622841.802807:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e1032b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:3280:x1875506866702080:12345-0@lo:103: 00010000:00010000:1.0:1788622841.802824:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622841.802831:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6585 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802846:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6585 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802866:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bace00/0xef842f43731d658c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6585 expref: 15 pid: 5803 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802885:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802926:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788622841.802949:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002749792s 00010000:00010000:1.0:1788622841.802955:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802963:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802969:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802976:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802982:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788622841.802987:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.802997:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.803018:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.803031:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622841.803111:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e1032b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3280:x1875506866702080:12345-0@lo:103: Request processed in 305us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622841.803120:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788622841.803171:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866702080:0@lo:103: 00010000:00010000:1.0:1788622841.803204:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.803215:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622841.803223:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb000/0xef842f43731d663b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622841.827120:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:7595:x1875506866701824:12345-0@lo:253: Request processed in 119090us (123371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622841.827141:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788622841.828049:0:7595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7595:1875506866701824:0@lo:253: 10000000:01000000:2.0:1788622841.828071:0:7595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788622841.828076:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788622841.828078:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788622841.828079:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788622841.828081:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788622841.828082:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788622841.828083:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788622841.828085:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788622841.828087:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788622841.828088:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788622841.828090:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788622841.828092:0:7595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788622841.828113:0:7595:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788622841.841323:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622841.841568:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788622841.841855:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622841.842051:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788622841.842278:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788622841.842596:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788622841.850419:0:7595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788622842.224341:0:7595:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788622842.224350:0:7595:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788622842.224383:0:7595:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788622842.224450:0:7595:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788622842.224467:0:7595:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788622842.224500:0:7595:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1788622842.419152:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622842.419185:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866702208:0@lo:13: 00000100:00100000:0.0:1788622842.419269:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622842.425754:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702208 00000100:00100000:3.0:1788622842.425783:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702208 00000100:00100000:3.0:1788622842.425868:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788622842.425880:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866702208:12345-0@lo:13: 00002000:00000024:3.0:1788622842.425930:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622842.426032:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866702208:12345-0@lo:13: Request processed in 154us (6763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622842.426040:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788622842.426093:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20c700 x1875506866702208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622842.426119:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866702208:0@lo:13: 00010000:00010000:3.0:1788622842.802697:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622843.820267:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622844.846014:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622845.869330:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622846.893129:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622847.020540:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866702464:0@lo:400: 00000100:00100000:3.0:1788622847.020653:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622847.020773:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788622847.020784:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866702336:0@lo:400: 00000100:00100000:0.0:1788622847.020848:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866702720:0@lo:400: 00000100:00100000:3.0:1788622847.020859:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622847.020904:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866702848:0@lo:400: 00000100:00100000:1.0:1788622847.021029:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866702592:0@lo:400: 00000100:00100000:0.0:1788622847.024263:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622847.024984:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702336 00000100:00100000:0.0:1788622847.024994:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702336 00000100:00100000:0.0:1788622847.025045:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788622847.025054:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3279:x1875506866702336:12345-0@lo:400: 00000100:00100000:0.0:1788622847.025126:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3279:x1875506866702336:12345-0@lo:400: Request processed in 74us (4274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622847.025133:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788622847.025178:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702720 00000100:00100000:0.0:1788622847.025182:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702720 00000100:00100000:0.0:1788622847.025225:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788622847.025232:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866702720:12345-0@lo:400: 00000100:00100000:0.0:1788622847.025270:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866702720:12345-0@lo:400: Request processed in 39us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622847.025291:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788622847.025461:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788622847.025500:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20e680 x1875506866702720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622847.025514:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866702720:0@lo:400: 00000100:00100000:0.0:1788622847.027184:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702464 00000100:00100000:0.0:1788622847.027199:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702464 00000100:00100000:0.0:1788622847.027242:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788622847.027250:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866702464:12345-0@lo:400: 00000100:00100000:0.0:1788622847.029313:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866702464:12345-0@lo:400: Request processed in 2056us (8653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622847.029327:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788622847.029708:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622847.029856:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702592 00000100:00100000:1.0:1788622847.029868:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702592 00000100:00100000:1.0:1788622847.029955:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788622847.029968:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866702592:12345-0@lo:400: 00000100:00080000:0.0:1788622847.030028:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788622847.030111:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20f100 x1875506866702592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622847.030127:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866702592:0@lo:400: 00000100:00100000:3.0:1788622847.030616:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622847.030839:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702848 00000100:00100000:3.0:1788622847.030861:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702848 00000100:00080000:0.0:1788622847.030899:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622847.030922:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788622847.030931:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866702848:12345-0@lo:400: 00000100:00100000:3.0:1788622847.030997:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866702848:12345-0@lo:400: Request processed in 68us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622847.031004:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788622847.031071:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20f800 x1875506866702848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622847.031087:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866702848:0@lo:400: 00010000:00080000:3.0:1788622847.031158:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20df80 x1875506866702464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622847.031170:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866702464:0@lo:400: 00000100:00100000:3.0:1788622847.031213:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866702336:0@lo:400: 00000100:00100000:1.0:1788622847.032792:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866702592:12345-0@lo:400: Request processed in 2818us (3741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622847.032806:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788622847.532049:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622847.532076:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866702976:0@lo:13: 00000100:00100000:2.0:1788622847.532152:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622847.532370:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866702976 00000100:00100000:2.0:1788622847.532378:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866702976 00000100:00100000:2.0:1788622847.532430:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788622847.532438:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866702976:12345-0@lo:13: 00002000:00000024:2.0:1788622847.532477:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622847.532535:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866702976:12345-0@lo:13: Request processed in 98us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622847.532542:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788622847.532587:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e37398000 x1875506866702976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622847.532605:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866702976:0@lo:13: 00010000:00010000:2.0:1788622847.916960:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622848.939916:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788622849.068964:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788622849.068972:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e1026d000 from 30 10000000:01000000:0.0:1788622849.068977:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788622849.069021:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.069035:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.069057:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622849.069082:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703104:0@lo:101: 00000100:00100000:0.0:1788622849.069152:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622849.069201:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.069257:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703104 00000100:00100000:1.0:1788622849.069267:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703104 00000100:00100000:1.0:1788622849.069323:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788622849.069335:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866703104:12345-0@lo:101: 00010000:00010000:1.0:1788622849.069348:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622849.069368:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6642 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.069395:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6642 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.069410:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6642 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.069420:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735a00, rc 0) 00000100:00100000:1.0:1788622849.069467:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866703104:12345-0@lo:101: Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.069474:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788622849.069527:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703104:0@lo:101: 00010000:00010000:1.0:1788622849.069542:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.069565:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.069618:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703232:0@lo:501: 00000100:00100000:1.0:1788622849.069644:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.069660:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.069672:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703232 00000100:00100000:1.0:1788622849.069676:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703232 00000100:00100000:1.0:1788622849.069699:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788622849.069705:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866703232:12345-0@lo:501: 00000100:00100000:1.0:1788622849.069994:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866703232:12345-0@lo:501: Request processed in 288us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.070010:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788622849.070045:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703232:0@lo:501: 00000100:00100000:1.0:1788622849.070071:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703360:0@lo:503: 00000100:00100000:1.0:1788622849.070109:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.070123:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.070135:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703360 00000100:00100000:1.0:1788622849.070138:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703360 00000100:00100000:1.0:1788622849.070158:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788622849.070164:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866703360:12345-0@lo:503: 00000100:00100000:1.0:1788622849.070372:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866703360:12345-0@lo:503: Request processed in 207us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.070380:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788622849.070420:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703360:0@lo:503: 00000100:00100000:1.0:1788622849.070584:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7929:1875506866703488:0@lo:502: 00000100:00100000:1.0:1788622849.070617:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.070637:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703488 00000100:00100000:1.0:1788622849.070641:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703488 00000100:00100000:1.0:1788622849.070663:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788622849.070669:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7929:x1875506866703488:12345-0@lo:502: 00000100:00100000:1.0:1788622849.070861:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7929:x1875506866703488:12345-0@lo:502: Request processed in 192us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.070868:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788622849.070898:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.070910:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7929:1875506866703488:0@lo:502: 00000100:00100000:1.0:1788622849.070957:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7929:1875506866703616:0@lo:502: 00000100:00100000:1.0:1788622849.070988:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.071006:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703616 00000100:00100000:1.0:1788622849.071010:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703616 00000100:00100000:1.0:1788622849.071030:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788622849.071036:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7929:x1875506866703616:12345-0@lo:502: 00000100:00100000:1.0:1788622849.071148:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:7929:x1875506866703616:12345-0@lo:502: Request processed in 112us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.071155:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788622849.071181:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.071192:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7929:1875506866703616:0@lo:502: 00000040:00080000:1.0:1788622849.071212:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788622849.071262:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788622849.071276:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788622849.071286:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071295:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622849.071305:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788622849.071307:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788622849.071310:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788622849.071330:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071338:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071358:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.071370:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703744:0@lo:101: 00000100:00100000:1.0:1788622849.071395:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.071409:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.071420:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703744 00000100:00100000:1.0:1788622849.071424:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703744 00000100:00100000:1.0:1788622849.071444:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788622849.071450:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866703744:12345-0@lo:101: 00010000:00010000:1.0:1788622849.071458:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622849.071469:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6650 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071488:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6650 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071497:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6650 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071505:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735200, rc 0) 00000100:00100000:1.0:1788622849.071532:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866703744:12345-0@lo:101: Request processed in 82us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.071539:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788622849.071567:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703744:0@lo:101: 00010000:00010000:1.0:1788622849.071578:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.071597:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.071633:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703872:0@lo:501: 00000100:00100000:1.0:1788622849.071658:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.071672:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.071683:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866703872 00000100:00100000:1.0:1788622849.071686:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866703872 00000100:00100000:1.0:1788622849.071706:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788622849.071712:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866703872:12345-0@lo:501: 00000100:00100000:1.0:1788622849.071932:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866703872:12345-0@lo:501: Request processed in 219us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.071938:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788622849.071984:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866703872:0@lo:501: 00000100:00100000:1.0:1788622849.072006:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704000:0@lo:503: 00000100:00100000:1.0:1788622849.072041:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.072055:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.072066:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704000 00000100:00100000:1.0:1788622849.072069:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704000 00000100:00100000:1.0:1788622849.072089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788622849.072094:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866704000:12345-0@lo:503: 00000100:00100000:1.0:1788622849.074161:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866704000:12345-0@lo:503: Request processed in 2057us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.074173:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788622849.074294:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704000:0@lo:503: 00000100:00100000:0.0:1788622849.077949:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7931:1875506866704128:0@lo:502: 00000100:00100000:0.0:1788622849.078033:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622849.078085:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.078158:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704128 00000100:00100000:1.0:1788622849.078173:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704128 00000100:00100000:1.0:1788622849.078229:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788622849.078240:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:7931:x1875506866704128:12345-0@lo:502: 00000100:00100000:1.0:1788622849.078574:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:7931:x1875506866704128:12345-0@lo:502: Request processed in 334us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.078582:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788622849.079009:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7931:1875506866704128:0@lo:502: 00000020:01000000:2.0:1788622849.079044:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788622849.079053:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622849.079056:0:7931:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788622849.079060:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788622849.079062:0:7931:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788622849.079085:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7931:1875506866704256:0@lo:502: 00000100:00100000:2.0:1788622849.079126:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622849.079157:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d07001540 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.079210:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704256 00000100:00100000:1.0:1788622849.079216:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704256 00000100:00100000:1.0:1788622849.079250:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788622849.079257:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:7931:x1875506866704256:12345-0@lo:502: 00000100:00100000:1.0:1788622849.079407:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:7931:x1875506866704256:12345-0@lo:502: Request processed in 150us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.079414:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788622849.079515:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7931:1875506866704256:0@lo:502: 00000020:01000000:2.0:1788622849.079534:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788622849.079538:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622849.079540:0:7931:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788622849.079613:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788622849.079840:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788622849.079859:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788622849.079870:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.079881:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622849.079892:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788622849.079895:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e0835b000 from 30 10000000:01000000:1.0:1788622849.079898:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788622849.079923:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.079932:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.080028:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.080043:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704384:0@lo:101: 00000100:00100000:1.0:1788622849.080076:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.080140:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2050ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622849.082851:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704384 00000100:00100000:0.0:1788622849.082870:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704384 00000100:00100000:0.0:1788622849.084073:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788622849.084089:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866704384:12345-0@lo:101: 00010000:00010000:0.0:1788622849.084109:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622849.084131:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d665e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.084161:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d665e expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.084173:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d665e expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.084183:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e00030000, rc 0) 00000100:00100000:0.0:1788622849.084269:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866704384:12345-0@lo:101: Request processed in 183us (4191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622849.084276:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788622849.085725:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704384:0@lo:101: 00010000:00010000:3.0:1788622849.085774:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622849.085798:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622849.085890:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704512:0@lo:501: 00000100:00100000:3.0:1788622849.085950:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622849.086993:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.089788:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704512 00000100:00100000:1.0:1788622849.089806:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704512 00000100:00100000:1.0:1788622849.089860:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788622849.089872:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866704512:12345-0@lo:501: 00000100:00100000:1.0:1788622849.090205:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866704512:12345-0@lo:501: Request processed in 335us (4253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.090213:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788622849.090276:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704512:0@lo:501: 00000100:00100000:1.0:1788622849.090331:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704640:0@lo:503: 00000100:00100000:1.0:1788622849.090376:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.090405:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372ded80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.090433:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704640 00000100:00100000:1.0:1788622849.090437:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704640 00000100:00100000:1.0:1788622849.090454:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788622849.090461:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866704640:12345-0@lo:503: 00000100:00100000:1.0:1788622849.090615:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866704640:12345-0@lo:503: Request processed in 153us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.090622:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788622849.090660:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866704640:0@lo:503: 00000100:00100000:1.0:1788622849.090926:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7934:1875506866704768:0@lo:502: 00000100:00100000:1.0:1788622849.090966:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.090986:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704768 00000100:00100000:1.0:1788622849.090990:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704768 00000100:00100000:1.0:1788622849.091010:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788622849.091015:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:7934:x1875506866704768:12345-0@lo:502: 00000100:00100000:1.0:1788622849.091163:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:7934:x1875506866704768:12345-0@lo:502: Request processed in 146us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.091170:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788622849.091202:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.091217:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7934:1875506866704768:0@lo:502: 00000100:00100000:1.0:1788622849.091261:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7934:1875506866704896:0@lo:502: 00000100:00100000:1.0:1788622849.091293:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.091313:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866704896 00000100:00100000:1.0:1788622849.091317:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866704896 00000100:00100000:1.0:1788622849.091332:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788622849.091338:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:7934:x1875506866704896:12345-0@lo:502: 00000100:00100000:1.0:1788622849.091450:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:7934:x1875506866704896:12345-0@lo:502: Request processed in 111us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.091456:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788622849.091481:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.091493:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7934:1875506866704896:0@lo:502: 00000040:00080000:1.0:1788622849.091509:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788622849.091555:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788622849.091578:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788622849.091597:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091609:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622849.091618:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788622849.091620:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e0835b000 from 5 10000000:01000000:1.0:1788622849.091623:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788622849.091647:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091656:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091665:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.091677:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705024:0@lo:101: 00000100:00100000:1.0:1788622849.091700:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.091713:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.091725:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705024 00000100:00100000:1.0:1788622849.091729:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705024 00000100:00100000:1.0:1788622849.091770:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788622849.091789:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866705024:12345-0@lo:101: 00010000:00010000:1.0:1788622849.091796:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622849.091808:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735c00/0xef842f43731d6673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d666c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091830:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735c00/0xef842f43731d6673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d666c expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091848:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735c00/0xef842f43731d6673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d666c expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091857:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735c00, rc 0) 00000100:00100000:1.0:1788622849.091886:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866705024:12345-0@lo:101: Request processed in 110us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.091892:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788622849.091921:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705024:0@lo:101: 00010000:00010000:1.0:1788622849.091933:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.091942:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.091979:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705152:0@lo:256: 00000100:00100000:1.0:1788622849.092006:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.092018:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.092028:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705152 00000100:00100000:1.0:1788622849.092031:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705152 00000100:00100000:1.0:1788622849.092047:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788622849.092053:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866705152:12345-0@lo:256: 20000000:01000000:1.0:1788622849.092065:0:5801:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788622849.092083:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788622849.092086:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788622849.092159:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866705152:12345-0@lo:256: Request processed in 106us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.092166:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788622849.092200:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705152:0@lo:256: 10000000:01000000:1.0:1788622849.092240:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788622849.092245:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092254:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622849.092262:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788622849.092263:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788622849.092266:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788622849.092281:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092287:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092294:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.092305:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705280:0@lo:101: 00000100:00100000:1.0:1788622849.092329:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.092342:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.092353:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705280 00000100:00100000:1.0:1788622849.092356:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705280 00000100:00100000:1.0:1788622849.092372:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788622849.092377:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866705280:12345-0@lo:101: 00010000:00010000:1.0:1788622849.092383:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622849.092390:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d667a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092409:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d667a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092417:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d667a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092423:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735400, rc 0) 00000100:00100000:1.0:1788622849.092451:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866705280:12345-0@lo:101: Request processed in 73us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.092457:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788622849.092484:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705280:0@lo:101: 00010000:00010000:1.0:1788622849.092496:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.092504:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.092545:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705408:0@lo:501: 00000100:00100000:1.0:1788622849.092569:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.092582:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.092594:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705408 00000100:00100000:1.0:1788622849.092597:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705408 00000100:00100000:1.0:1788622849.095867:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788622849.095905:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866705408:12345-0@lo:501: 00000100:00100000:1.0:1788622849.096250:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866705408:12345-0@lo:501: Request processed in 359us (3678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.096259:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788622849.096365:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705408:0@lo:501: 00000100:00100000:1.0:1788622849.096417:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705536:0@lo:503: 00000100:00100000:1.0:1788622849.096463:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.096494:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.096509:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705536 00000100:00100000:1.0:1788622849.096516:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705536 00000100:00100000:1.0:1788622849.097137:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788622849.097148:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866705536:12345-0@lo:503: 00000100:00100000:1.0:1788622849.097432:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866705536:12345-0@lo:503: Request processed in 286us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.097440:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788622849.098085:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866705536:0@lo:503: 00000100:00100000:1.0:1788622849.100075:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7937:1875506866705664:0@lo:502: 00000100:00100000:1.0:1788622849.100164:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.100205:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705664 00000100:00100000:1.0:1788622849.100211:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705664 00000100:00100000:1.0:1788622849.100254:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788622849.100263:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:7937:x1875506866705664:12345-0@lo:502: 00000100:00100000:1.0:1788622849.101146:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:7937:x1875506866705664:12345-0@lo:502: Request processed in 880us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.101156:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788622849.101217:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06571e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788622849.101238:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7937:1875506866705664:0@lo:502: 00000020:01000000:1.0:1788622849.101267:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788622849.101274:0:7937:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788622849.101281:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622849.101283:0:7937:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788622849.101296:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788622849.101299:0:7937:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.119@tcp to nid 0x20000c0a8cc77 (192.168.204.119@tcp) 00000020:01000000:1.0:1788622849.101323:0:7937:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788622849.101325:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788622849.101340:0:7937:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff997d04c4b380) 00000020:00000080:1.0:1788622849.101365:0:7937:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788622849.101371:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788622849.101442:0:7937:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788622849.101449:0:7937:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788622849.101456:0:7937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d668f 00010000:00080000:1.0:1788622849.101484:0:7937:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e3a31a000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.119@tcp at head 00010000:00010000:1.0:1788622849.103699:0:7937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788622849.104233:0:7937:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788622849.104252:0:7937:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788622849.105034:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788622849.106914:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788622849.107002:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788622849.107075:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788622849.111900:0:7938:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788622849.111912:0:7938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788622849.112723:0:7937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788622849.112736:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788622849.112853:0:7937:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788622849.112879:0:7937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d6696 00000100:00080000:0.0:1788622849.112891:0:7937:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788622849.112897:0:7937:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e3a31a000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:0.0:1788622849.113013:0:7937:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e0612c000 x1875506866705792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788622849.113070:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866705792:0@lo:8: 00000100:00100000:2.0:1788622849.113142:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788622849.113198:0:7937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788622849.113252:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622849.113257:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622849.113259:0:7937:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788622849.113261:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622849.113266:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622849.113267:0:7937:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788622849.113269:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788622849.113271:0:7937:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788622849.113294:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7937:1875506866705920:0@lo:502: 00000100:00100000:0.0:1788622849.113346:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622849.113373:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705920 00000100:00100000:0.0:1788622849.113380:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705920 00000100:00100000:3.0:1788622849.113840:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866706176:0@lo:400: 00000100:00100000:3.0:1788622849.113876:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.114066:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866706048:0@lo:400: 00000100:00100000:1.0:1788622849.114094:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.114133:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706176 00000100:00100000:1.0:1788622849.114138:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706176 00000100:00100000:1.0:1788622849.114181:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706048 00000100:00100000:1.0:1788622849.114185:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706048 00000100:00100000:1.0:1788622849.114205:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788622849.114213:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866706176:12345-0@lo:400: 00000100:00100000:1.0:1788622849.114261:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866706176:12345-0@lo:400: Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.114267:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788622849.114282:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788622849.114297:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866706048:12345-0@lo:400: 00000100:00100000:1.0:1788622849.114330:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866706048:12345-0@lo:400: Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622849.114335:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788622849.114352:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788622849.114680:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20df80 x1875506866706048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622849.114694:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866706048:0@lo:400: 00000100:00100000:2.0:1788622849.114870:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866705792 00000100:00100000:2.0:1788622849.114875:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866705792 00000100:00100000:2.0:1788622849.114947:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788622849.114952:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875506866705792:12345-0@lo:8: 00010000:00080000:2.0:1788622849.114978:0:6657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1788622849.115012:0:6657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d669d 00002000:00100000:2.0:1788622849.115025:0:6657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff997e37394000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788622849.115030:0:6657:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788622849.115034:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788622849.115160:0:6657:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788622849.115315:0:6657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788622849.115342:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997e07345800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622849.115401:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3277:x1875506866705792:12345-0@lo:8: Request processed in 447us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622849.115408:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788622849.115712:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788622849.115722:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:7937:x1875506866705920:12345-0@lo:502: 00000100:00100000:0.0:1788622849.116002:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:7937:x1875506866705920:12345-0@lo:502: Request processed in 282us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622849.116009:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788622849.116056:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788622849.116079:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:7937:1875506866705920:0@lo:502: 00000020:01000000:0.0:1788622849.116107:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622849.116113:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622849.116116:0:7937:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788622849.116121:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788622849.116356:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788622849.116374:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788622849.116384:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.116394:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622849.116404:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788622849.116407:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff997e06120000 from 1 10000000:01000000:1.0:1788622849.116410:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788622849.116444:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.116452:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.116460:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.116478:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866706560:0@lo:101: 00000100:00100000:1.0:1788622849.116520:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.116559:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065713c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788622849.116693:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20f800 x1875506866706176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622849.116705:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866706176:0@lo:400: 00000100:00100000:3.0:1788622849.116732:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866706304:0@lo:400: 00000100:00100000:3.0:1788622849.116806:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622849.116832:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622849.116839:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866706432:0@lo:400: 00000100:00100000:3.0:1788622849.116866:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622849.116900:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706432 00000100:00100000:3.0:1788622849.116907:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706432 00000100:00100000:0.0:1788622849.117078:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706560 00000100:00100000:0.0:1788622849.117082:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706560 00000100:00100000:0.0:1788622849.117115:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788622849.117123:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866706560:12345-0@lo:101: 00010000:00010000:0.0:1788622849.117133:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622849.117147:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d66a4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.117171:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d66a4 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.117182:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d66a4 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622849.117191:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e00031400, rc 0) 00000100:00100000:0.0:1788622849.117222:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866706560:12345-0@lo:101: Request processed in 100us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622849.117228:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788622849.117292:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866706560:0@lo:101: 00010000:00010000:1.0:1788622849.117306:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.117315:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622849.117361:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866706688:0@lo:501: 00000100:00100000:1.0:1788622849.117386:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622849.117415:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622849.117466:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788622849.117474:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866706432:12345-0@lo:400: 00000100:00100000:3.0:1788622849.117514:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866706432:12345-0@lo:400: Request processed in 41us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622849.117520:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788622849.117538:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706304 00000100:00100000:3.0:1788622849.117542:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706304 00000100:00100000:3.0:1788622849.117707:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788622849.117725:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866706304:12345-0@lo:400: 00000100:00100000:3.0:1788622849.117798:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866706304:12345-0@lo:400: Request processed in 75us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622849.117805:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788622849.117859:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706688 00000100:00100000:0.0:1788622849.117863:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706688 00000100:00100000:0.0:1788622849.117886:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788622849.117893:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866706688:12345-0@lo:501: 00000100:00100000:0.0:1788622849.118133:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866706688:12345-0@lo:501: Request processed in 239us (745us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788622849.118149:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788622849.118483:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866706688:0@lo:501: 10000000:01000000:1.0:1788622849.118513:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788622849.118521:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622849.118530:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788622849.118664:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788622849.118669:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788622849.118696:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20c000 x1875506866706432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622849.118708:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866706432:0@lo:400: 00010000:00080000:3.0:1788622849.118720:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20e680 x1875506866706304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622849.118728:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866706304:0@lo:400: 00010000:00080000:2.0:1788622849.120640:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e0612c000 x1875506866705792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788622859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622849.120655:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788622849.120664:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788622849.120675:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788622849.120681:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788622849.120685:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e3a31a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788622849.120712:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788622849.120718:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866705792:0@lo:8: 00000004:00080000:2.0:1788622849.120796:0:7938:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788622849.121197:0:7938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173076453653ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788622849.177923:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788622849.178534:0:7939:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788622849.178566:0:7939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866706944:0@lo:7: 00000100:00100000:0.0:1788622849.178631:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788622849.178651:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866706816:0@lo:13: 00000100:00100000:3.0:1788622849.178656:0:7939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622849.178699:0:7939:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f0b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788622849.178706:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622849.179770:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706944 00000100:00100000:2.0:1788622849.179795:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706944 00000100:00080000:3.0:1788622849.179845:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788622849.179871:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788622849.179883:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7939:x1875506866706944:12345-0@lo:7: 00000100:00100000:3.0:1788622849.184289:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866706816 00000100:00100000:3.0:1788622849.184305:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866706816 00000100:00100000:3.0:1788622849.184379:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788622849.184394:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875506866706816:12345-0@lo:13: 00002000:00000024:3.0:1788622849.184447:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788622849.184670:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875506866706816:12345-0@lo:13: Request processed in 280us (5963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622849.184679:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788622849.185349:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20e680 x1875506866706816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622849.185376:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866706816:0@lo:13: 00002000:00080000:2.0:1788622849.190325:0:6657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788622849.190347:0:6657:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788622849.191610:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7939:x1875506866706944:12345-0@lo:7: Request processed in 11721us (12952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622849.191626:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788622849.191678:0:7939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20c000 x1875506866706944/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788622865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622849.191707:0:7939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866706944:0@lo:7: 00000004:00080000:3.0:1788622849.191723:0:7939:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788622849.191804:0:7939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866707072:0@lo:5: 00000100:00100000:3.0:1788622849.191849:0:7939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622849.191927:0:7939:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f0b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788622849.191979:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707072 00000100:00100000:0.0:1788622849.191986:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707072 00000100:00100000:0.0:1788622849.192043:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788622849.192053:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7939:x1875506866707072:12345-0@lo:5: 00002000:00080000:0.0:1788622849.192081:0:6655:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788622849.192085:0:6655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788622849.192417:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7939:x1875506866707072:12345-0@lo:5: Request processed in 365us (566us total) trans 4294967297 rc 0/0 00010000:00080000:3.0:1788622849.192467:0:7939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20c000 x1875506866707072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788622865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622849.192479:0:7939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866707072:0@lo:5: 00000004:00080000:3.0:1788622849.192489:0:7939:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788622849.192517:0:7939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866707200:0@lo:700: 00000100:00100000:0.0:1788622849.192550:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788622849.192704:0:7939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622849.192731:0:7939:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f0b3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788622849.192898:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707200 00000100:00100000:2.0:1788622849.192903:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707200 00000100:00100000:2.0:1788622849.193026:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622849.193046:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7939:x1875506866707200:12345-0@lo:700: 00000100:00100000:2.0:1788622849.193078:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3739aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6663:1875506866707328:0@lo:700: 00000100:00100000:2.0:1788622849.193109:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622849.193128:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d07001180 going to sleep for 11 seconds 00000100:00100000:2.0:1788622849.193149:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707328 00000100:00100000:2.0:1788622849.193152:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707328 00000100:00100000:2.0:1788622849.193178:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788622849.193185:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6663:x1875506866707328:12345-0@lo:700: 40000000:02000000:2.0:1788622849.251482:0:5816:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788622849.263818:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6663:x1875506866707328:12345-0@lo:700: Request processed in 70623us (70698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622849.263833:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788622849.263897:0:6663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3739aa00 x1875506866707328/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788622865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622849.263912:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3739aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6663:1875506866707328:0@lo:700: 40000000:02000000:2.0:1788622849.263928:0:6663:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:02000400:3.0:1788622849.353182:0:7962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:0.0:1788622849.407762:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788622849.407799:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788622849.407978:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7939:x1875506866707200:12345-0@lo:700: Request processed in 214929us (215270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622849.407991:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788622849.408093:0:7939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20e680 x1875506866707200/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788622865 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622849.408104:0:7939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788622849.408119:0:7939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866707200:0@lo:700: 00000004:02000040:3.0:1788622849.508180:0:7939:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788622849.518051:0:7939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866707456:0@lo:5: 00000100:00100000:0.0:1788622849.518124:0:7939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622849.518185:0:7939:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788622849.520014:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707456 00000100:00100000:3.0:1788622849.520028:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707456 00000100:00100000:3.0:1788622849.520097:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788622849.520107:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7939:x1875506866707456:12345-0@lo:5: 00002000:00080000:2.0:1788622849.527983:0:6657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788622849.528004:0:6657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788622849.536386:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7939:x1875506866707456:12345-0@lo:5: Request processed in 16272us (18253us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788622849.536399:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788622849.536534:0:7939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e0612f800 x1875506866707456/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788622865 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622849.536553:0:7939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7939:1875506866707456:0@lo:5: 00000004:00080000:0.0:1788622849.536569:0:7939:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788622849.966367:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622850.989305:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622852.012011:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622852.653701:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622852.679292:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866707584:0@lo:13: 00000100:00100000:0.0:1788622852.679701:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622852.688880:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707584 00000100:00100000:3.0:1788622852.688899:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707584 00000100:00100000:3.0:1788622852.690354:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788622852.690374:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866707584:12345-0@lo:13: 00002000:00000024:3.0:1788622852.690432:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622852.690571:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866707584:12345-0@lo:13: Request processed in 203us (10871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622852.690783:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788622852.690847:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a20c700 x1875506866707584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622852.690880:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866707584:0@lo:13: 00000100:00080000:0.0:1788622852.701176:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788622853.037066:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622854.060989:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622854.187982:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788622854.188021:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866707712:0@lo:13: 00000100:00100000:2.0:1788622854.188116:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622854.188239:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707712 00000100:00100000:0.0:1788622854.188251:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707712 00000100:00100000:0.0:1788622854.188326:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788622854.188337:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866707712:12345-0@lo:13: 00002000:00000024:0.0:1788622854.188387:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622854.188462:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866707712:12345-0@lo:13: Request processed in 127us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622854.188470:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788622854.188494:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788622854.188531:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e0612c700 x1875506866707712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622854.188567:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866707712:0@lo:13: 00000100:00100000:0.0:1788622854.189295:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866707840:0@lo:400: 00000100:00100000:0.0:1788622854.189344:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622854.189595:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866708224:0@lo:400: 00000100:00100000:3.0:1788622854.189638:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622854.189640:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866707968:0@lo:400: 00000100:00100000:2.0:1788622854.189693:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622854.189900:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788622854.189908:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866708096:0@lo:400: 00000100:00100000:2.0:1788622854.189934:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622854.189976:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708224 00000100:00100000:2.0:1788622854.189984:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708224 00000100:00100000:2.0:1788622854.190043:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788622854.190051:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866708224:12345-0@lo:400: 00000100:00100000:2.0:1788622854.190095:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866708224:12345-0@lo:400: Request processed in 45us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622854.190102:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788622854.190114:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a314a80 x1875506866708224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622854.190125:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707968 00000100:00100000:3.0:1788622854.190126:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866708224:0@lo:400: 00000100:00100000:2.0:1788622854.190128:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707968 00000100:00100000:2.0:1788622854.190153:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708096 00000100:00100000:2.0:1788622854.190175:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708096 00000100:00100000:2.0:1788622854.190277:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788622854.190285:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866707968:12345-0@lo:400: 00000100:00100000:2.0:1788622854.190321:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866707968:12345-0@lo:400: Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622854.190327:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788622854.190338:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788622854.190343:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866708096:12345-0@lo:400: 00000100:00100000:2.0:1788622854.190367:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866708096:12345-0@lo:400: Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622854.190372:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788622854.190401:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a317b80 x1875506866708096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622854.190410:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866708096:0@lo:400: 00010000:00080000:2.0:1788622854.190419:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a314380 x1875506866707968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622854.190427:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866707968:0@lo:400: 00000100:00100000:3.0:1788622854.190496:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866707840 00000100:00100000:3.0:1788622854.190501:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866707840 00000100:00100000:3.0:1788622854.190533:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788622854.190540:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866707840:12345-0@lo:400: 00000100:00080000:1.0:1788622854.193976:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788622854.193989:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788622854.194590:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866707840:12345-0@lo:400: Request processed in 4039us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622854.194608:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788622854.194651:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622854.194674:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866708352:0@lo:400: 00000100:00100000:3.0:1788622854.194777:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622854.195024:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708352 00000100:00100000:1.0:1788622854.195035:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708352 00000100:00100000:1.0:1788622854.195107:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788622854.195118:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866708352:12345-0@lo:400: 00000100:00100000:1.0:1788622854.195186:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866708352:12345-0@lo:400: Request processed in 70us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622854.195208:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788622854.195305:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a316300 x1875506866708352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788622870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622854.195321:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866708352:0@lo:400: 00000100:00080000:3.0:1788622854.195346:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622854.195430:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866707840:0@lo:400: 00000001:00080000:0.0:1788622854.822602:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788622855.085244:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622856.108076:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622856.474839:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622856.475369:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858295680 00000100:00100000:0.0:1788622856.475384:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858295680 00000100:00100000:0.0:1788622856.475453:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 113 00000100:00100000:0.0:1788622856.475572:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1875506858295680:12345-192.168.204.19@tcp:250: 00010000:00080000:0.0:1788622856.475610:0:5803:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 797b375f-aaf7-47e6-9eba-3f58f94c80a1@192.168.204.19@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1788622856.475667:0:5803:0:(genops.c:1385:class_connect()) connect: client 797b375f-aaf7-47e6-9eba-3f58f94c80a1, cookie 0xef842f43731d66b2 00000100:00080000:0.0:1788622856.476261:0:5803:0:(import.c:65:import_set_state_nolock()) ffff997e072df000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788622856.476371:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+5:2347:x1875506858295680:12345-192.168.204.19@tcp:250: Request processed in 801us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622856.476382:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 113 00000100:00100000:2.0:1788622856.482279:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622856.486551:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858295552 00000100:00100000:3.0:1788622856.486575:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858295552 00000100:00100000:3.0:1788622856.487091:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 114 00000100:00100000:3.0:1788622856.487109:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+5:5575:x1875506858295552:12345-192.168.204.19@tcp:101: 00010000:00010000:3.0:1788622856.487156:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622856.487186:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e64c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622856.487229:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622856.487244:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622856.487256:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fb000, rc 0) 00000100:00100000:3.0:1788622856.487363:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+6:5575:x1875506858295552:12345-192.168.204.19@tcp:101: Request processed in 259us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622856.487372:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 114 00000100:00100000:2.0:1788622856.492568:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.492799:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858295808 00000100:00100000:1.0:1788622856.492813:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858295808 00000100:00100000:1.0:1788622856.492888:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 115 00000100:00100000:1.0:1788622856.492902:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+6:5575:x1875506858295808:12345-192.168.204.19@tcp:501: 00000100:00100000:1.0:1788622856.493417:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+6:5575:x1875506858295808:12345-192.168.204.19@tcp:501: Request processed in 516us (858us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788622856.493435:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 115 00000100:00100000:2.0:1788622856.496172:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622856.496786:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858295936 00000100:00100000:0.0:1788622856.496802:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858295936 00000100:00100000:0.0:1788622856.496873:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 116 00000100:00100000:0.0:1788622856.496887:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+6:5575:x1875506858295936:12345-192.168.204.19@tcp:101: 00010000:00010000:0.0:1788622856.496912:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622856.496939:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e653 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622856.497272:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622856.497289:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622856.497302:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e00030600, rc 0) 00000100:00100000:0.0:1788622856.497391:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+7:5575:x1875506858295936:12345-192.168.204.19@tcp:101: Request processed in 507us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622856.497398:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 116 00000100:00100000:2.0:1788622856.501198:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.501385:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296064 00000100:00100000:1.0:1788622856.501399:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296064 00000100:00100000:1.0:1788622856.501489:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:1.0:1788622856.501502:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+7:5575:x1875506858296064:12345-192.168.204.19@tcp:501: 00000100:00100000:1.0:1788622856.502008:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5575:x1875506858296064:12345-192.168.204.19@tcp:501: Request processed in 507us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.502018:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:2.0:1788622856.505968:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622856.506321:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296192 00000100:00100000:3.0:1788622856.506346:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296192 00000100:00100000:3.0:1788622856.506487:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:3.0:1788622856.506501:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5575:x1875506858296192:12345-192.168.204.19@tcp:503: 00000100:00100000:2.0:1788622856.507674:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5575:x1875506858296192:12345-192.168.204.19@tcp:503: Request processed in 1169us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622856.507687:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:2.0:1788622856.512223:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622856.512345:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296320 00000100:00100000:0.0:1788622856.512359:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296320 00000100:00100000:0.0:1788622856.512426:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 119 00000100:00100000:0.0:1788622856.512445:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5593:x1875506858296320:12345-192.168.204.19@tcp:502: 00000100:00100000:0.0:1788622856.513194:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5593:x1875506858296320:12345-192.168.204.19@tcp:502: Request processed in 748us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622856.513205:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 119 00000100:00100000:3.0:1788622856.555501:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622856.555685:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296448 00000100:00100000:2.0:1788622856.555701:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296448 00000100:00100000:2.0:1788622856.555823:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 120 00000100:00100000:2.0:1788622856.555835:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5593:x1875506858296448:12345-192.168.204.19@tcp:502: 00000100:00100000:2.0:1788622856.556219:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5593:x1875506858296448:12345-192.168.204.19@tcp:502: Request processed in 385us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622856.556229:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 120 00000100:00100000:2.0:1788622856.569079:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.570144:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296576 00000100:00100000:1.0:1788622856.570161:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296576 00000100:00100000:1.0:1788622856.570239:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 121 00000100:00100000:1.0:1788622856.570251:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5575:x1875506858296576:12345-192.168.204.19@tcp:101: 00010000:00010000:1.0:1788622856.570276:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622856.570304:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13734600/0xef842f43731d66c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e67d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622856.570363:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13734600/0xef842f43731d66c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e67d expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622856.570409:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13734600/0xef842f43731d66c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e67d expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622856.570421:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734600, rc 0) 00000100:00100000:1.0:1788622856.570510:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5575:x1875506858296576:12345-192.168.204.19@tcp:101: Request processed in 261us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.570518:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 121 00000100:00100000:1.0:1788622856.574499:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622856.574679:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296704 00000100:00100000:0.0:1788622856.574697:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296704 00000100:00100000:1.0:1788622856.575022:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 122 00000100:00100000:1.0:1788622856.575037:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5575:x1875506858296704:12345-192.168.204.19@tcp:256: 20000000:01000000:1.0:1788622856.575075:0:5801:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788622856.575109:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788622856.575114:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788622856.575118:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788622856.575121:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788622856.577587:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5575:x1875506858296704:12345-192.168.204.19@tcp:256: Request processed in 2541us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.577603:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 122 00000100:00100000:2.0:1788622856.580588:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.580884:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296832 00000100:00100000:1.0:1788622856.580897:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296832 00000100:00100000:1.0:1788622856.580972:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00100000:1.0:1788622856.580984:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5575:x1875506858296832:12345-192.168.204.19@tcp:101: 00010000:00010000:1.0:1788622856.581007:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622856.581035:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e684 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622856.581099:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622856.581113:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622856.581124:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734800, rc 0) 00000100:00100000:1.0:1788622856.581408:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5575:x1875506858296832:12345-192.168.204.19@tcp:101: Request processed in 425us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.581417:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00100000:2.0:1788622856.584472:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.584713:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858296960 00000100:00100000:1.0:1788622856.584729:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858296960 00000100:00100000:1.0:1788622856.584842:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 124 00000100:00100000:1.0:1788622856.584855:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5575:x1875506858296960:12345-192.168.204.19@tcp:501: 00000100:00100000:1.0:1788622856.585326:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5575:x1875506858296960:12345-192.168.204.19@tcp:501: Request processed in 471us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622856.587778:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.588019:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 124 00000100:00100000:1.0:1788622856.588084:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297088 00000100:00100000:1.0:1788622856.588094:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297088 00000100:00100000:1.0:1788622856.588135:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 125 00000100:00100000:1.0:1788622856.588145:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5575:x1875506858297088:12345-192.168.204.19@tcp:503: 00000100:00100000:1.0:1788622856.589266:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5575:x1875506858297088:12345-192.168.204.19@tcp:503: Request processed in 1114us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.589278:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 125 00000100:00100000:2.0:1788622856.595247:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.595445:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297216 00000100:00100000:1.0:1788622856.595479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297216 00000100:00100000:1.0:1788622856.595599:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 126 00000100:00100000:1.0:1788622856.595614:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5597:x1875506858297216:12345-192.168.204.19@tcp:502: 00000100:00100000:1.0:1788622856.596044:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5597:x1875506858297216:12345-192.168.204.19@tcp:502: Request processed in 431us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.596054:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 126 00000100:00100000:2.0:1788622856.598438:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622856.599007:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297344 00000100:00100000:0.0:1788622856.599019:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297344 00000100:00100000:0.0:1788622856.599075:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 127 00000100:00100000:0.0:1788622856.599087:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5597:x1875506858297344:12345-192.168.204.19@tcp:502: 00000100:00100000:0.0:1788622856.599790:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5597:x1875506858297344:12345-192.168.204.19@tcp:502: Request processed in 701us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622856.599801:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 127 00000100:00100000:3.0:1788622856.604387:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622856.604817:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297472 00000100:00100000:1.0:1788622856.604831:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297472 00000100:00100000:1.0:1788622856.604911:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788622856.604922:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1875506858297472:12345-192.168.204.19@tcp:38: 00010000:00080000:1.0:1788622856.604962:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1788622856.605072:0:5810:0:(genops.c:1385:class_connect()) connect: client 3d43f78d-d80c-4ed1-81b4-dc22eca474fb, cookie 0xef842f43731d66d5 00000004:00100000:1.0:1788622856.605113:0:5810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788622856.605122:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788622856.644215:0:5810:0:(import.c:65:import_set_state_nolock()) ffff997d04f0a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788622856.647425:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2347:x1875506858297472:12345-192.168.204.19@tcp:38: Request processed in 42482us (43031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622856.647445:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00010000:00010000:2.0:1788622857.132088:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622857.146600:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622857.146702:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297600 00000100:00100000:1.0:1788622857.146717:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297600 00000100:00100000:1.0:1788622857.146888:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:1.0:1788622857.146902:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:0:x1875506858297600:12345-192.168.204.19@tcp:41: 00000004:00000024:1.0:1788622857.146966:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788622857.147063:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:0:x1875506858297600:12345-192.168.204.19@tcp:41: Request processed in 164us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622857.147071:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00080000:3.0:1788622857.149261:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622857.149996:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622857.150116:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297728 00000100:00100000:1.0:1788622857.150130:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297728 00000100:00100000:1.0:1788622857.150242:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788622857.150255:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5575:x1875506858297728:12345-192.168.204.19@tcp:41: 00000004:00000024:1.0:1788622857.150299:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788622857.150410:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5575:x1875506858297728:12345-192.168.204.19@tcp:41: Request processed in 158us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622857.150419:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:0.0:1788622857.155235:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622857.155417:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297856 00000100:00100000:1.0:1788622857.155431:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297856 00000100:00100000:1.0:1788622857.155560:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:1.0:1788622857.155572:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5575:x1875506858297856:12345-192.168.204.19@tcp:40: 00000100:00100000:1.0:1788622857.155724:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5575:x1875506858297856:12345-192.168.204.19@tcp:40: Request processed in 154us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622857.155732:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:0.0:1788622857.162006:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622857.162065:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622857.162198:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298240 00000100:00100000:1.0:1788622857.162212:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298240 00000100:00100000:1.0:1788622857.162282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:1.0:1788622857.162297:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5575:x1875506858298240:12345-192.168.204.19@tcp:33: 00000100:00100000:0.0:1788622857.162814:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622857.170995:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622857.171057:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298368 00000100:00100000:0.0:1788622857.171071:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298368 00000100:00100000:0.0:1788622857.171146:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 128 00000100:00100000:0.0:1788622857.171159:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858298368:12345-192.168.204.19@tcp:400: 00000100:00100000:0.0:1788622857.171252:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858298368:12345-192.168.204.19@tcp:400: Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622857.171277:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 128 00000100:00100000:2.0:1788622857.174634:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858297984 00000100:00100000:2.0:1788622857.174656:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858297984 00000100:00100000:2.0:1788622857.174813:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298112 00000100:00100000:2.0:1788622857.174818:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298112 00000100:00100000:2.0:1788622857.174843:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:2.0:1788622857.175026:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858297984:12345-192.168.204.19@tcp:8: 00010000:00080000:2.0:1788622857.175072:0:6657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1788622857.175122:0:6657:0:(genops.c:1385:class_connect()) connect: client 3d43f78d-d80c-4ed1-81b4-dc22eca474fb, cookie 0xef842f43731d66dc 00002000:00100000:2.0:1788622857.175138:0:6657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d43f78d-d80c-4ed1-81b4-dc22eca474fb/ffff997e0847a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788622857.175172:0:6657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788622857.177960:0:6657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788622857.178045:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997e0847c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622857.178957:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2347:x1875506858297984:12345-192.168.204.19@tcp:8: Request processed in 4097us (16884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622857.178972:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:2.0:1788622857.179014:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:2.0:1788622857.179022:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858298112:12345-192.168.204.19@tcp:8: 00010000:00080000:2.0:1788622857.179059:0:6657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1788622857.179101:0:6657:0:(genops.c:1385:class_connect()) connect: client 3d43f78d-d80c-4ed1-81b4-dc22eca474fb, cookie 0xef842f43731d66e3 00002000:00100000:2.0:1788622857.179120:0:6657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d43f78d-d80c-4ed1-81b4-dc22eca474fb/ffff997e0847d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788622857.179153:0:6657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788622857.180308:0:6657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788622857.180815:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997e0847a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622857.181034:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2347:x1875506858298112:12345-192.168.204.19@tcp:8: Request processed in 2007us (18228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622857.181046:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000004:00080000:2.0:1788622857.190457:0:5812:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28043us 00000004:00200000:0.0:1788622857.218108:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788622857.218300:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5575:x1875506858298240:12345-192.168.204.19@tcp:33: Request processed in 55995us (56497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622857.218329:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:0.0:1788622857.477664:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622857.477892:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298496 00000100:00100000:2.0:1788622857.477906:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298496 00000100:00100000:2.0:1788622857.477987:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:2.0:1788622857.478000:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5614:x1875506858298496:12345-192.168.204.19@tcp:101: 00010000:00010000:2.0:1788622857.478030:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622857.484386:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d66ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6ae expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622857.484482:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d66f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622857.484511:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d66f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622857.484528:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d66f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622857.484570:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788622857.484575:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622857.484922:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d66f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622857.484956:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d66ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6ae expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622857.484979:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d66f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6ae expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622857.484987:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097a00) 00010000:00010000:2.0:1788622857.484990:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788622857.484994:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bada00, rc 0) 00000100:00100000:2.0:1788622857.485073:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:5614:x1875506858298496:12345-192.168.204.19@tcp:101: Request processed in 7074us (7422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622857.486162:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:0.0:1788622857.773491:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788622857.773526:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866708480:0@lo:13: 00000100:00100000:0.0:1788622857.773601:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622857.774426:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708480 00000100:00100000:1.0:1788622857.774437:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708480 00000100:00100000:1.0:1788622857.774511:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788622857.774522:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866708480:12345-0@lo:13: 00002000:00000024:1.0:1788622857.774545:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622857.774620:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866708480:12345-0@lo:13: Request processed in 89us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622857.774631:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788622857.774801:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3978d180 x1875506866708480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622857.774823:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866708480:0@lo:13: 00000100:00080000:3.0:1788622857.775044:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788622858.156234:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622859.180281:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622859.308158:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866708608:0@lo:13: 00000100:00100000:2.0:1788622859.308284:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622859.308631:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708608 00000100:00100000:1.0:1788622859.308645:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708608 00000100:00100000:0.0:1788622859.308991:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866708736:0@lo:400: 00000100:00100000:0.0:1788622859.309043:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622859.309070:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866709248:0@lo:400: 00000100:00100000:0.0:1788622859.309099:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622859.309121:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788622859.309139:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866708864:0@lo:400: 00000100:00100000:0.0:1788622859.309174:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622859.309214:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709248 00000100:00100000:0.0:1788622859.309218:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709248 00000100:00100000:0.0:1788622859.309256:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708864 00000100:00100000:0.0:1788622859.309259:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708864 00000100:00100000:0.0:1788622859.309282:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788622859.309292:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866709248:12345-0@lo:400: 00000100:00100000:0.0:1788622859.309362:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866709248:12345-0@lo:400: Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622859.309370:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788622859.309399:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788622859.309406:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866708864:12345-0@lo:400: 00000100:00100000:0.0:1788622859.309439:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866708864:12345-0@lo:400: Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622859.309445:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788622859.309572:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788622859.309599:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866708608:12345-0@lo:13: 00002000:00000024:1.0:1788622859.309643:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622859.309688:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866708608:12345-0@lo:13: Request processed in 109us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622859.309793:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866709120:0@lo:400: 00000100:00100000:2.0:1788622859.309830:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788622859.309875:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e0612c000 x1875506866708608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622859.309887:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788622859.309913:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866708608:0@lo:13: 00000100:00100000:2.0:1788622859.309926:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622859.309932:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866708992:0@lo:400: 00000100:00100000:2.0:1788622859.309956:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622859.309986:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709120 00000100:00100000:2.0:1788622859.309991:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709120 00000100:00100000:2.0:1788622859.310026:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788622859.310034:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866709120:12345-0@lo:400: 00000100:00100000:2.0:1788622859.310069:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866709120:12345-0@lo:400: Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622859.310076:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788622859.310095:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708992 00000100:00100000:2.0:1788622859.310099:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708992 00000100:00100000:2.0:1788622859.310123:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788622859.310129:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866708992:12345-0@lo:400: 00000100:00100000:0.0:1788622859.310362:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866708864:0@lo:400: 00000100:00100000:0.0:1788622859.310375:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866709248:0@lo:400: 00000100:00080000:0.0:1788622859.310419:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788622859.310425:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788622859.310427:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788622859.310615:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788622859.310664:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a2d3800 x1875506866709120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622859.310676:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866709120:0@lo:400: 00000100:00100000:2.0:1788622859.310881:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866708992:12345-0@lo:400: Request processed in 750us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622859.310890:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788622859.311145:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866708736 00000100:00100000:3.0:1788622859.311162:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866708736 00000100:00100000:3.0:1788622859.311214:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788622859.311224:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866708736:12345-0@lo:400: 00000100:00100000:3.0:1788622859.311299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866708736:12345-0@lo:400: Request processed in 77us (2255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622859.311306:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788622859.311558:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866708992:0@lo:400: 00000100:00100000:0.0:1788622859.311645:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866708736:0@lo:400: 00000100:00100000:1.0:1788622859.829011:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622859.833227:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298624 00000100:00100000:0.0:1788622859.833251:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298624 00000100:00100000:0.0:1788622859.833452:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:0.0:1788622859.833466:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:5667:x1875506858298624:12345-192.168.204.19@tcp:41: 00000004:00000024:0.0:1788622859.833544:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788622859.833676:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:5667:x1875506858298624:12345-192.168.204.19@tcp:41: Request processed in 213us (4679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622859.833684:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00080000:1.0:1788622859.835058:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622859.838890:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622859.839591:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298752 00000100:00100000:0.0:1788622859.839606:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298752 00000100:00100000:0.0:1788622859.839715:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:0.0:1788622859.839728:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5667:x1875506858298752:12345-192.168.204.19@tcp:13: 00002000:00000024:0.0:1788622859.839812:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788622859.840205:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788622859.840635:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5667:x1875506858298752:12345-192.168.204.19@tcp:13: Request processed in 183us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622859.840668:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788622859.846700:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622859.847148:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858298880 00000100:00100000:2.0:1788622859.847163:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858298880 00000100:00100000:2.0:1788622859.847262:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:2.0:1788622859.847306:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5667:x1875506858298880:12345-192.168.204.19@tcp:13: 00002000:00000024:2.0:1788622859.847344:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788622859.847877:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788622859.847958:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:5667:x1875506858298880:12345-192.168.204.19@tcp:13: Request processed in 654us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622859.847969:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00010000:00010000:2.0:1788622860.204184:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622861.231820:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788622861.513132:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000001:00100000:3.0:1788622861.525696:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000001:00100000:2.0:1788622861.934101:0:5831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00010000:00010000:2.0:1788622862.252444:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622862.554177:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622862.554237:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622862.554269:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622862.554302:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622862.554369:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299008 00000100:00100000:2.0:1788622862.554384:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299008 00000100:00100000:2.0:1788622862.554465:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 130 00000100:00100000:2.0:1788622862.554477:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858299008:12345-192.168.204.19@tcp:400: 00000100:00100000:2.0:1788622862.554589:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858299008:12345-192.168.204.19@tcp:400: Request processed in 114us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622862.554598:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 130 00000100:00100000:2.0:1788622862.554641:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299264 00000100:00100000:2.0:1788622862.554645:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299264 00000100:00100000:2.0:1788622862.554686:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299392 00000100:00100000:2.0:1788622862.554689:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299392 00000100:00100000:2.0:1788622862.554708:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:2.0:1788622862.554715:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858299264:12345-192.168.204.19@tcp:400: 00000100:00100000:2.0:1788622862.554780:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858299264:12345-192.168.204.19@tcp:400: Request processed in 65us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622862.554786:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:2.0:1788622862.554817:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:2.0:1788622862.554825:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858299392:12345-192.168.204.19@tcp:400: 00000100:00100000:2.0:1788622862.554869:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858299392:12345-192.168.204.19@tcp:400: Request processed in 45us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622862.554876:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00080000:2.0:1788622862.555062:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788622862.555068:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788622862.555290:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299136 00000100:00100000:0.0:1788622862.555296:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299136 00000100:00100000:0.0:1788622862.555341:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:0.0:1788622862.555349:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858299136:12345-192.168.204.19@tcp:400: 00000100:00100000:0.0:1788622862.555391:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858299136:12345-192.168.204.19@tcp:400: Request processed in 44us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622862.555398:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00080000:2.0:1788622862.557078:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622862.898409:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866709376:0@lo:13: 00000100:00100000:0.0:1788622862.898547:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622862.899332:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709376 00000100:00100000:2.0:1788622862.899345:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709376 00000100:00080000:0.0:1788622862.899730:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622862.899830:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788622862.899845:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866709376:12345-0@lo:13: 00002000:00000024:2.0:1788622862.899901:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622862.900001:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866709376:12345-0@lo:13: Request processed in 160us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622862.900010:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788622862.900092:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3978f800 x1875506866709376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622862.900121:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866709376:0@lo:13: 00000001:02000400:3.0:1788622862.983738:0:8268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788622863.278364:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622864.306537:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622864.428237:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866709504:0@lo:13: 00000100:00100000:2.0:1788622864.428356:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622864.428704:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866709760:0@lo:400: 00000100:00100000:3.0:1788622864.428767:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622864.428798:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622864.428804:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866709888:0@lo:400: 00000100:00100000:3.0:1788622864.428830:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622864.428871:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709760 00000100:00100000:3.0:1788622864.428883:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709760 00000100:00100000:3.0:1788622864.428937:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709888 00000100:00100000:3.0:1788622864.428940:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709888 00000100:00100000:3.0:1788622864.428977:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788622864.428986:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866709760:12345-0@lo:400: 00000100:00100000:3.0:1788622864.429054:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866709760:12345-0@lo:400: Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622864.429063:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788622864.429082:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788622864.429088:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866709888:12345-0@lo:400: 00000100:00100000:3.0:1788622864.429115:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866709888:12345-0@lo:400: Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622864.429121:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788622864.429156:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622864.429194:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866709888:0@lo:400: 00000100:00100000:3.0:1788622864.429207:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866709760:0@lo:400: 00000100:00100000:3.0:1788622864.429241:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866710016:0@lo:400: 00000100:00100000:3.0:1788622864.429276:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622864.429298:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788622864.429304:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866709632:0@lo:400: 00000100:00100000:3.0:1788622864.429335:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622864.429360:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866710144:0@lo:400: 00000100:00100000:3.0:1788622864.429382:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622864.429405:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866710144 00000100:00100000:3.0:1788622864.429409:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866710144 00000100:00100000:3.0:1788622864.429438:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788622864.429446:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866710144:12345-0@lo:400: 00000100:00100000:3.0:1788622864.429495:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866710144:12345-0@lo:400: Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622864.429502:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788622864.429517:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622864.429534:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866710144:0@lo:400: 00000100:00100000:2.0:1788622864.429829:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866710016 00000100:00100000:2.0:1788622864.429835:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866710016 00000100:00100000:2.0:1788622864.429883:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622864.429891:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866710016:12345-0@lo:400: 00000100:00100000:2.0:1788622864.429933:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866710016:12345-0@lo:400: Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622864.429941:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788622864.429963:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709632 00000100:00100000:2.0:1788622864.429966:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709632 00000100:00100000:2.0:1788622864.430005:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788622864.430012:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866709632:12345-0@lo:400: 00000100:00100000:2.0:1788622864.430045:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866709632:12345-0@lo:400: Request processed in 35us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622864.430051:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788622864.430240:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866709504 00000100:00100000:0.0:1788622864.430245:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866709504 00000100:00100000:0.0:1788622864.430289:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788622864.430298:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866709504:12345-0@lo:13: 00002000:00000024:0.0:1788622864.430341:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622864.430387:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866709504:12345-0@lo:13: Request processed in 91us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622864.430394:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788622864.430869:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788622864.430874:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788622864.430910:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866709632:0@lo:400: 00010000:00080000:3.0:1788622864.430930:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9c380 x1875506866710016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622864.430943:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866710016:0@lo:400: 00010000:00080000:3.0:1788622864.430973:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a2d2680 x1875506866709504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622864.430991:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866709504:0@lo:13: 00010000:00010000:2.0:1788622865.324947:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622866.349523:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.372725:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788622867.522121:0:8416:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4eab1d20 20000000:00000080:0.0:1788622867.522144:0:8416:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997e36e5a400 uarg=0000000000000000 20000000:01000000:0.0:1788622867.522281:0:8416:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788622867.522284:0:8416:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788622867.522288:0:8416:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788622867.522295:0:8416:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788622867.522302:0:8416:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788622867.522326:0:8416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788622867.522329:0:8416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788622867.523136:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788622867.523142:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788622867.534579:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788622867.546002:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788622867.546132:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788622867.546187:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788622867.546242:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788622867.546246:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788622867.555343:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788622867.556354:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788622867.556428:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788622867.556507:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788622867.556535:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788622867.556539:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788622867.558461:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788622867.560936:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788622867.563333:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788622867.563910:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788622867.563947:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788622867.565064:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788622867.570097:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788622867.582894:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788622867.584030:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788622867.584105:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788622867.584135:0:8416:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788622867.584162:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585612:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d65ee expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585624:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6618 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585632:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6642 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585651:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6650 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585659:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d665e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585667:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d667a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585675:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d66a4 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585710:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585718:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.585728:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.600905:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.600937:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 9 pid: 5803 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.600959:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710272:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622867.601119:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.601130:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.601139:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710400:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622867.601227:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d66a4 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.601238:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d66a4 expref: 18 pid: 5803 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.601250:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710528:0@lo:104: 00000100:00100000:2.0:1788622867.601307:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788622867.601480:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d667a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.601500:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d667a expref: 18 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.601517:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710656:0@lo:104: 00000100:00100000:1.0:1788622867.601578:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788622867.601627:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d665e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.601635:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d665e expref: 18 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.601644:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710784:0@lo:104: 00010000:00010000:1.0:1788622867.601669:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6650 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.601677:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6650 expref: 18 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.601685:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710912:0@lo:104: 00010000:00010000:1.0:1788622867.601709:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6642 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.601716:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6642 expref: 18 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.601781:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866711040:0@lo:104: 00010000:00010000:1.0:1788622867.601809:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6618 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.601818:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6618 expref: 18 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.601825:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866711168:0@lo:104: 00010000:00010000:1.0:1788622867.601887:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d65ee expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.601896:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d65ee expref: 18 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.601904:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866711296:0@lo:104: 00000100:00100000:0.0:1788622867.601908:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788622867.601931:0:8416:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e099f1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788622867.601948:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622867.601978:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622867.601989:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622867.602000:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622867.602008:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622867.602019:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866710528 00000100:00100000:0.0:1788622867.602028:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866710528 00000100:00100000:1.0:1788622867.604899:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866710656 00000100:00100000:1.0:1788622867.604915:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866710656 00000100:00100000:1.0:1788622867.604931:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866710784 00000100:00100000:1.0:1788622867.604934:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866710784 00000100:00100000:1.0:1788622867.604947:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866710912 00000100:00100000:1.0:1788622867.604949:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866710912 00000100:00100000:1.0:1788622867.604958:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711040 00000100:00100000:1.0:1788622867.604961:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711040 00000100:00100000:1.0:1788622867.604970:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711168 00000100:00100000:1.0:1788622867.604972:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711168 00000100:00100000:1.0:1788622867.604980:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711296 00000100:00100000:1.0:1788622867.604983:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711296 00000100:00100000:1.0:1788622867.605000:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788622867.605028:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:8416:x1875506866710528:12345-0@lo:104: 00010000:00010000:1.0:1788622867.605052:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.605173:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788622867.605179:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+9:8416:x1875506866710528:12345-0@lo:104: Request processed in 154us (3873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.605187:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788622867.605207:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788622867.605213:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3738c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+8:8416:x1875506866710656:12345-0@lo:104: 00010000:00010000:1.0:1788622867.605222:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.605259:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788622867.605264:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3738c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+8:8416:x1875506866710656:12345-0@lo:104: Request processed in 52us (3687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.605270:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788622867.605313:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788622867.605319:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+7:8416:x1875506866710784:12345-0@lo:104: 00010000:00010000:1.0:1788622867.605328:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.605360:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788622867.605365:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+7:8416:x1875506866710784:12345-0@lo:104: Request processed in 47us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.605371:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788622867.605383:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788622867.605396:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+6:8416:x1875506866710912:12345-0@lo:104: 00010000:00010000:1.0:1788622867.605404:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.605444:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788622867.605450:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+6:8416:x1875506866710912:12345-0@lo:104: Request processed in 55us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.605456:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788622867.605468:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788622867.605473:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:8416:x1875506866711040:12345-0@lo:104: 00010000:00010000:2.0:1788622867.606029:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788622867.606042:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606052:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.606057:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606069:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.606077:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.606084:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.606144:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606152:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.606182:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606190:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d66a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d66ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606220:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788622867.606224:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606231:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735600 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.606235:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606243:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.606250:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.606256:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.606271:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606277:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.606283:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606290:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13735600/0xef842f43731d667a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6681 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606300:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788622867.606303:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606320:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.606324:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606331:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.606338:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.606344:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.606356:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606363:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.606382:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606390:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734200/0xef842f43731d665e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6665 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606400:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622867.606403:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606410:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.606413:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606443:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.606449:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.606455:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.606469:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606476:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.606493:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606500:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734c00/0xef842f43731d6650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6657 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.606511:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.606513:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.606515:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.606523:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.606530:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622867.606559:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866711808:0@lo:103: 00010000:00010000:1.0:1788622867.607023:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.607101:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788622867.607110:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:8416:x1875506866711040:12345-0@lo:104: Request processed in 1635us (5118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.607120:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788622867.607154:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788622867.607164:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:8416:x1875506866711168:12345-0@lo:104: 00010000:00010000:1.0:1788622867.607172:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.607207:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788622867.607212:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:8416:x1875506866711168:12345-0@lo:104: Request processed in 52us (5211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.607218:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788622867.607230:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788622867.607248:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:8416:x1875506866711296:12345-0@lo:104: 00010000:00010000:1.0:1788622867.607257:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.607289:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788622867.607294:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:8416:x1875506866711296:12345-0@lo:104: Request processed in 49us (5285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.607300:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788622867.607402:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622867.607483:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622867.607493:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866711680:0@lo:103: 00000100:00100000:2.0:1788622867.607520:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788622867.607546:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788622867.607552:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.607567:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00031e00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.607571:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.607579:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.607586:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.607592:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.607622:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.607628:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.607636:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622867.607836:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710528:0@lo:104: 00000100:00100000:0.0:1788622867.607853:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710656:0@lo:104: 00000100:00100000:0.0:1788622867.607864:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710784:0@lo:104: 00000100:00100000:0.0:1788622867.607874:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710912:0@lo:104: 00000100:00100000:0.0:1788622867.607881:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866711040:0@lo:104: 00000100:00100000:0.0:1788622867.607889:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866711168:0@lo:104: 00000100:00100000:0.0:1788622867.607898:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866711296:0@lo:104: 00000100:00100000:1.0:1788622867.610694:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711808 00000100:00100000:1.0:1788622867.610711:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711808 00010000:00010000:1.0:1788622867.610794:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6650 expref: 19 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.610841:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711680 00000100:00100000:1.0:1788622867.610845:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711680 00010000:00010000:1.0:1788622867.610859:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d665e expref: 20 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.610886:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788622867.610897:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+20:3281:x1875506866711808:12345-0@lo:103: 00010000:00010000:1.0:1788622867.610917:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622867.610923:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6650 expref: 20 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.610937:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6650 expref: 20 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.610961:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735200/0xef842f43731d6657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6650 expref: 20 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.611011:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622867.611112:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866711808:12345-0@lo:103: Request processed in 216us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.611120:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788622867.611138:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788622867.611145:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3281:x1875506866711680:12345-0@lo:103: 00010000:00010000:1.0:1788622867.611152:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622867.611156:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d665e expref: 18 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.611166:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d665e expref: 18 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.611177:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00030000/0xef842f43731d6665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d665e expref: 18 pid: 5804 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622867.611187:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622867.611209:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3281:x1875506866711680:12345-0@lo:103: Request processed in 65us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622867.611215:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788622867.611310:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e00031e00/0xef842f43731d6642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6649 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611331:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788622867.611337:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611344:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bac000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.611350:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611374:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.611383:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.611390:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.611441:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611448:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.611459:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611467:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d661f expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611477:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622867.611481:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611486:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00030400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622867.611489:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611497:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622867.611504:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622867.611516:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788622867.611530:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611536:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788622867.611543:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611550:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e00030400/0xef842f43731d65ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d65f5 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.611564:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.611566:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.611568:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.611577:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622867.611584:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622867.611627:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866711680:0@lo:103: 00000100:00100000:2.0:1788622867.611638:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866711808:0@lo:103: 00000100:00100000:2.0:1788622867.611664:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622867.611675:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866712192:0@lo:103: 00000100:00100000:2.0:1788622867.611720:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622867.611832:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866711552:0@lo:103: 00000100:00100000:2.0:1788622867.611859:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622867.611875:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866712064:0@lo:103: 00000100:00100000:2.0:1788622867.611894:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622867.611907:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788622867.611921:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866711424:0@lo:103: 00000100:00100000:2.0:1788622867.611942:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622867.611953:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866711936:0@lo:103: 00000100:00100000:2.0:1788622867.611981:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622867.612026:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712192 00000100:00100000:2.0:1788622867.612032:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712192 00010000:00010000:2.0:1788622867.612056:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d65ee expref: 17 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.612074:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711552 00000100:00100000:2.0:1788622867.612076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711552 00010000:00010000:2.0:1788622867.612088:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d667a expref: 18 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.612098:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712064 00000100:00100000:2.0:1788622867.612101:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712064 00010000:00010000:2.0:1788622867.612111:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6618 expref: 19 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.612121:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711424 00000100:00100000:2.0:1788622867.612123:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711424 00010000:00010000:2.0:1788622867.612134:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d66a4 expref: 20 pid: 5803 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.612144:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866711936 00000100:00100000:2.0:1788622867.612145:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866711936 00010000:00010000:2.0:1788622867.612156:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6642 expref: 21 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622867.612167:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788622867.612174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+21:3281:x1875506866712192:12345-0@lo:103: 00010000:00010000:2.0:1788622867.612192:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622867.612198:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d65ee expref: 21 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612206:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d65ee expref: 21 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612218:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad800/0xef842f43731d65f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d65ee expref: 21 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612230:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622867.612260:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+20:3281:x1875506866712192:12345-0@lo:103: Request processed in 87us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.612267:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788622867.612281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788622867.612288:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866711552:12345-0@lo:103: 00010000:00010000:2.0:1788622867.612296:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622867.612300:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d667a expref: 19 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612309:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d667a expref: 19 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612319:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735400/0xef842f43731d6681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d667a expref: 19 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612328:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622867.612356:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3279:x1875506866711552:12345-0@lo:103: Request processed in 69us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.612371:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788622867.612384:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788622867.612390:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3279:x1875506866712064:12345-0@lo:103: 00010000:00010000:2.0:1788622867.612398:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622867.612402:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6618 expref: 17 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612411:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6618 expref: 17 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612436:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00031c00/0xef842f43731d661f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6618 expref: 17 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612445:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622867.612468:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3279:x1875506866712064:12345-0@lo:103: Request processed in 79us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.612474:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788622867.612485:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788622867.612491:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:3279:x1875506866711424:12345-0@lo:103: 00010000:00010000:2.0:1788622867.612500:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622867.612504:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d66a4 expref: 15 pid: 5803 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612512:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d66a4 expref: 15 pid: 5803 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612522:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00031400/0xef842f43731d66ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d66a4 expref: 15 pid: 5803 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612540:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622867.612563:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3279:x1875506866711424:12345-0@lo:103: Request processed in 72us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.612569:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788622867.612583:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788622867.612592:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e10328c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:3279:x1875506866711936:12345-0@lo:103: 00010000:00010000:2.0:1788622867.612604:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622867.612608:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6642 expref: 13 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612615:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6642 expref: 13 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612624:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735a00/0xef842f43731d6649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6642 expref: 13 pid: 5801 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.612632:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622867.612652:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e10328c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:3279:x1875506866711936:12345-0@lo:103: Request processed in 63us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.612657:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788622867.612708:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866712192:0@lo:103: 00000100:00100000:2.0:1788622867.612729:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866711424:0@lo:103: 00000100:00100000:2.0:1788622867.612737:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866711936:0@lo:103: 00000100:00100000:2.0:1788622867.612771:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866711552:0@lo:103: 00000100:00100000:2.0:1788622867.612779:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866712064:0@lo:103: 00000100:00100000:0.0:1788622867.614224:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622867.614263:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299520 00000100:00100000:3.0:1788622867.614273:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299520 00010000:00010000:3.0:1788622867.614327:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 10 pid: 5803 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622867.614367:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788622867.614377:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858299520:12345-192.168.204.19@tcp:103: 00010000:00010000:3.0:1788622867.614393:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622867.614398:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 10 pid: 5803 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.614412:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 10 pid: 5803 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622867.614447:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622867.614503:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858299520:12345-192.168.204.19@tcp:103: Request processed in 127us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622867.614512:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00010000:00010000:1.0:1788622867.617209:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00030600/0xef842f43731d66c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e653 expref: 9 pid: 5803 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622867.617240:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710272:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622867.622812:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622867.623015:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1875506866710400:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788622867.623088:0:8416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622867.623603:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299648 00000100:00100000:0.0:1788622867.623624:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299648 00010000:00010000:0.0:1788622867.623682:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622867.623770:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:0.0:1788622867.623783:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:2349:x1875506858299648:12345-192.168.204.19@tcp:103: 00010000:00010000:0.0:1788622867.623806:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622867.623814:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623840:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623865:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb000/0xef842f43731d66b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e64c expref: 9 pid: 5804 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623889:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623900:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623922:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623930:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623938:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623946:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623964:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622867.623970:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.623993:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.624014:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622867.624026:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622867.624107:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:2349:x1875506858299648:12345-192.168.204.19@tcp:103: Request processed in 326us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622867.624116:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00010000:00010000:2.0:1788622867.624548:0:8416:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.624560:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622867.624568:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb400/0xef842f43731d66f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622867.684234:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622867.684290:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622867.684324:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622867.684362:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622867.684400:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299904 00000100:00100000:0.0:1788622867.684424:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299904 00000100:00100000:2.0:1788622867.684457:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300032 00000100:00100000:2.0:1788622867.684465:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300032 00000100:00100000:0.0:1788622867.684513:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:2.0:1788622867.684521:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300160 00000100:00100000:0.0:1788622867.684527:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858299904:12345-192.168.204.19@tcp:400: 00000100:00100000:2.0:1788622867.684528:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300160 00000100:00100000:2.0:1788622867.684552:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788622867.684562:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858300032:12345-192.168.204.19@tcp:400: 00000100:00100000:0.0:1788622867.684643:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858299904:12345-192.168.204.19@tcp:400: Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622867.684646:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858299776 00000100:00100000:3.0:1788622867.684652:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858299776 00000100:00100000:3.0:1788622867.684688:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 132 00000100:00100000:3.0:1788622867.684695:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:2351:x1875506858299776:12345-192.168.204.19@tcp:400: 00000100:00100000:0.0:1788622867.685908:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:0.0:1788622867.685967:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788622867.686243:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1788622867.686295:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788622867.686302:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788622867.686307:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622867.687968:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858300032:12345-192.168.204.19@tcp:400: Request processed in 3288us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.687987:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788622867.688037:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:2.0:1788622867.688055:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858300160:12345-192.168.204.19@tcp:400: 00000100:00100000:2.0:1788622867.688120:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858300160:12345-192.168.204.19@tcp:400: Request processed in 73us (3756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.688126:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:2.0:1788622867.698029:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:2351:x1875506858299776:12345-192.168.204.19@tcp:400: Request processed in 13315us (13803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622867.698050:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 132 00000100:00100000:0.0:1788622868.014167:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622868.014211:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866712320:0@lo:13: 00000100:00100000:0.0:1788622868.014332:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622868.014661:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712320 00000100:00100000:3.0:1788622868.014673:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712320 00000100:00100000:3.0:1788622868.014785:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788622868.014799:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866712320:12345-0@lo:13: 00002000:00000024:3.0:1788622868.014846:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622868.014931:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866712320:12345-0@lo:13: Request processed in 136us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622868.014939:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788622868.014991:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9ea00 x1875506866712320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622868.015017:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866712320:0@lo:13: 00000100:00080000:0.0:1788622868.015264:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788622868.399505:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622869.350700:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622869.352375:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300288 00000100:00100000:2.0:1788622869.352404:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300288 00000100:00100000:2.0:1788622869.352502:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 133 00000100:00100000:2.0:1788622869.352516:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+8:5589:x1875506858300288:12345-192.168.204.19@tcp:101: 00010000:00010000:2.0:1788622869.352538:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622869.352618:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bad800/0xef842f43731d66ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6b5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.352659:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad800/0xef842f43731d66ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6b5 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.352674:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bad800/0xef842f43731d66ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6b5 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.352686:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad800, rc 0) 00000100:00100000:2.0:1788622869.352897:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858300288:12345-192.168.204.19@tcp:101: Request processed in 383us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.352905:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 133 10000000:01000000:2.0:1788622869.357351:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788622869.357363:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e3ccbd000 from 39 10000000:01000000:2.0:1788622869.357370:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788622869.357452:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.357468:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.357482:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622869.357552:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866712448:0@lo:101: 00000100:00100000:2.0:1788622869.357647:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.357910:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e099f1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.358068:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712448 00000100:00100000:1.0:1788622869.358080:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712448 00000100:00100000:1.0:1788622869.358140:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788622869.358152:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+12:5806:x1875506866712448:12345-0@lo:101: 00010000:00010000:1.0:1788622869.358183:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622869.358204:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e07284400/0xef842f43731d670d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6706 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.358241:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e07284400/0xef842f43731d670d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6706 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.358254:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e07284400/0xef842f43731d670d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6706 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.358267:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284400, rc 0) 00000100:00100000:3.0:1788622869.358285:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622869.358346:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866712448:12345-0@lo:101: Request processed in 196us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.358354:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788622869.358399:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300416 00000100:00100000:1.0:1788622869.358403:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300416 00000100:00100000:2.0:1788622869.360407:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 135 00000100:00100000:2.0:1788622869.360441:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858300416:12345-192.168.204.19@tcp:501: 00000100:00100000:2.0:1788622869.361789:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858300416:12345-192.168.204.19@tcp:501: Request processed in 1179us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.361804:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 135 00000100:00100000:3.0:1788622869.362034:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866712448:0@lo:101: 00010000:00010000:3.0:1788622869.362070:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.362091:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622869.362370:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866712576:0@lo:501: 00000100:00100000:3.0:1788622869.362514:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.362581:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.363465:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712576 00000100:00100000:2.0:1788622869.363478:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712576 00000100:00100000:2.0:1788622869.363534:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788622869.363546:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866712576:12345-0@lo:501: 00000100:00100000:2.0:1788622869.363972:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866712576:12345-0@lo:501: Request processed in 428us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.363980:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788622869.364533:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866712576:0@lo:501: 00000100:00100000:3.0:1788622869.364608:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866712704:0@lo:503: 00000100:00100000:3.0:1788622869.365817:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.365864:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.366250:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712704 00000100:00100000:2.0:1788622869.366261:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712704 00000100:00100000:2.0:1788622869.366309:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788622869.366319:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866712704:12345-0@lo:503: 00000100:00100000:2.0:1788622869.367876:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866712704:12345-0@lo:503: Request processed in 1552us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.367889:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788622869.368057:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866712704:0@lo:503: 00000100:00100000:1.0:1788622869.369254:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622869.369409:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300544 00000100:00100000:0.0:1788622869.369420:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300544 00000100:00100000:0.0:1788622869.369487:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 138 00000100:00100000:0.0:1788622869.369499:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858300544:12345-192.168.204.19@tcp:503: 00000100:00100000:0.0:1788622869.370048:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858300544:12345-192.168.204.19@tcp:503: Request processed in 549us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.370057:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 138 00000100:00100000:2.0:1788622869.372910:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8433:1875506866712832:0@lo:502: 00000100:00100000:2.0:1788622869.373040:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.373323:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712832 00000100:00100000:0.0:1788622869.373334:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712832 00000100:00100000:0.0:1788622869.373523:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788622869.373536:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:8433:x1875506866712832:12345-0@lo:502: 00000100:00100000:2.0:1788622869.373949:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e081793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.379937:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:8433:x1875506866712832:12345-0@lo:502: Request processed in 6388us (6880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.379959:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788622869.380155:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8433:1875506866712832:0@lo:502: 00000100:00100000:2.0:1788622869.380356:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8433:1875506866712960:0@lo:502: 00000100:00100000:2.0:1788622869.380499:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.380548:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07096840 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.380722:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866712960 00000100:00100000:0.0:1788622869.380730:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866712960 00000100:00100000:0.0:1788622869.380807:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788622869.380816:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:8433:x1875506866712960:12345-0@lo:502: 00000100:00100000:0.0:1788622869.381268:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:8433:x1875506866712960:12345-0@lo:502: Request processed in 450us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.381277:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788622869.386736:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622869.387538:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300672 00000100:00100000:0.0:1788622869.387550:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300672 00000100:00100000:2.0:1788622869.387856:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8433:1875506866712960:0@lo:502: 00000040:00080000:2.0:1788622869.387936:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788622869.388084:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788622869.388112:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788622869.388127:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.388139:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622869.388151:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788622869.388155:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788622869.388158:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788622869.388204:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.388212:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.388223:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622869.388249:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713088:0@lo:101: 00000100:00100000:3.0:1788622869.388442:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.388547:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713088 00000100:00100000:0.0:1788622869.388552:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713088 00000100:00100000:0.0:1788622869.388583:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 141 00000100:00100000:1.0:1788622869.388667:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788622869.388669:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:6061:x1875506858300672:12345-192.168.204.19@tcp:502: 00000100:00100000:1.0:1788622869.388698:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+13:5806:x1875506866713088:12345-0@lo:101: 00010000:00010000:1.0:1788622869.388710:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622869.388727:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e07285000/0xef842f43731d671b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6714 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.388776:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e07285000/0xef842f43731d671b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6714 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.388799:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e07285000/0xef842f43731d671b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6714 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.388810:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285000, rc 0) 00000100:00100000:1.0:1788622869.388862:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866713088:12345-0@lo:101: Request processed in 185us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.388869:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788622869.389054:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:6061:x1875506858300672:12345-192.168.204.19@tcp:502: Request processed in 460us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.389063:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 141 00000100:00100000:3.0:1788622869.389144:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622869.389173:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713088:0@lo:101: 00010000:00010000:3.0:1788622869.389190:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.389201:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622869.389342:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713216:0@lo:501: 00000100:00100000:3.0:1788622869.389379:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.389407:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.389898:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713216 00000100:00100000:1.0:1788622869.389905:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713216 00000100:00100000:1.0:1788622869.389954:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788622869.389963:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866713216:12345-0@lo:501: 00000100:00100000:1.0:1788622869.394007:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866713216:12345-0@lo:501: Request processed in 4032us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.394025:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788622869.394348:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713216:0@lo:501: 00000100:00100000:3.0:1788622869.394437:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713344:0@lo:503: 00000100:00100000:3.0:1788622869.394505:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.394573:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.395028:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622869.395246:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713344 00000100:00100000:2.0:1788622869.395255:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713344 00000100:00100000:2.0:1788622869.395317:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300800 00000100:00100000:2.0:1788622869.395322:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300800 00000100:00100000:2.0:1788622869.395341:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788622869.395352:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866713344:12345-0@lo:503: 00000100:00100000:2.0:1788622869.395627:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866713344:12345-0@lo:503: Request processed in 275us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.395634:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788622869.395671:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713344:0@lo:503: 00000100:00100000:2.0:1788622869.395679:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 145 00000100:00100000:2.0:1788622869.395689:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:6061:x1875506858300800:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788622869.395958:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:6061:x1875506858300800:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 270us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.395965:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 145 00000100:00100000:1.0:1788622869.402581:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622869.402876:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858300928 00000100:00100000:2.0:1788622869.402887:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858300928 00000100:00100000:2.0:1788622869.402952:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 146 00000100:00100000:2.0:1788622869.402965:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858300928:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622869.402985:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622869.403029:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bac600/0xef842f43731d6722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.403068:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac600/0xef842f43731d6722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6bc expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.403093:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bac600/0xef842f43731d6722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6bc expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.403104:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac600, rc 0) 00000100:00100000:3.0:1788622869.403378:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8434:1875506866713472:0@lo:502: 00000100:00100000:3.0:1788622869.403814:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.403873:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.404340:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713472 00000100:00100000:1.0:1788622869.404349:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713472 00000100:00100000:1.0:1788622869.404479:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788622869.404490:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:8434:x1875506866713472:12345-0@lo:502: 00000100:00100000:2.0:1788622869.404757:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858300928:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 1775us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.404767:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 146 00000100:00100000:1.0:1788622869.406627:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:8434:x1875506866713472:12345-0@lo:502: Request processed in 2130us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.406642:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788622869.406903:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8434:1875506866713472:0@lo:502: 00000020:01000000:3.0:1788622869.406952:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788622869.406964:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622869.406967:0:8434:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788622869.406973:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788622869.407024:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8434:1875506866713600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622869.407103:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622869.407201:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713600 00000100:00100000:1.0:1788622869.407210:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713600 00000100:00100000:2.0:1788622869.408100:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788622869.408117:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:8434:x1875506866713600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622869.410660:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.411058:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:8434:x1875506866713600:12345-0@lo:502:llog_process_th.0 Request processed in 2943us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.411072:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788622869.411491:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622869.411526:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301056 00000100:00100000:0.0:1788622869.411539:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301056 00000100:00100000:0.0:1788622869.411588:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 149 00000100:00100000:0.0:1788622869.411712:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301056:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622869.411919:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8434:1875506866713600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788622869.411971:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622869.411981:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622869.411984:0:8434:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788622869.411988:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000100:00100000:0.0:1788622869.412861:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301056:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 1148us (1369us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788622869.412873:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 149 00000020:01000000:3.0:1788622869.412990:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788622869.413021:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788622869.413036:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.413049:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622869.413060:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788622869.413063:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e1026d000 from 39 10000000:01000000:3.0:1788622869.413066:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788622869.413123:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.413133:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.413144:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622869.413183:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788622869.413245:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.413298:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.413422:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713728 00000100:00100000:0.0:1788622869.413431:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713728 00000100:00100000:0.0:1788622869.413477:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788622869.413486:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:5806:x1875506866713728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622869.413500:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622869.413517:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e4100f600/0xef842f43731d6730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.413550:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e4100f600/0xef842f43731d6730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6729 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.413580:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e4100f600/0xef842f43731d6730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6729 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.413592:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e4100f600, rc 0) 00000100:00100000:0.0:1788622869.413629:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866713728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.413635:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788622869.413800:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788622869.413823:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.413834:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622869.413893:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622869.413921:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.413938:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788622869.413953:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713856 00000100:00100000:3.0:1788622869.413957:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713856 00000100:00100000:3.0:1788622869.413980:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788622869.413987:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866713856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622869.414653:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866713856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 663us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622869.414661:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788622869.416290:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.416525:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.416725:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.417030:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.417215:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866713984 00000100:00100000:2.0:1788622869.417222:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866713984 00000100:00100000:2.0:1788622869.417324:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788622869.417336:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866713984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622869.417612:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866713984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622869.417785:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866713984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622869.417903:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788622869.418559:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8435:1875506866714112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622869.418642:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.419026:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.419233:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714112 00000100:00100000:0.0:1788622869.419242:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714112 00000100:00100000:0.0:1788622869.419284:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788622869.419295:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:8435:x1875506866714112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622869.419609:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:8435:x1875506866714112:12345-0@lo:502:llog_process_th.0 Request processed in 315us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.419625:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788622869.419683:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8435:1875506866714112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622869.419763:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8435:1875506866714240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622869.419802:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.420544:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.420577:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714240 00000100:00100000:2.0:1788622869.420583:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714240 00000100:00100000:2.0:1788622869.420781:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788622869.420791:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:8435:x1875506866714240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622869.421049:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:8435:x1875506866714240:12345-0@lo:502:llog_process_th.0 Request processed in 259us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.421056:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788622869.421192:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8435:1875506866714240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788622869.421227:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788622869.421610:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788622869.421757:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788622869.421771:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.421784:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622869.421796:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788622869.421806:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788622869.421809:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788622869.421843:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.421851:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.421861:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622869.421881:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866714368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.421921:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.422115:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.422267:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714368 00000100:00100000:1.0:1788622869.422275:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714368 00000100:00100000:1.0:1788622869.422320:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788622869.422328:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:5806:x1875506866714368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788622869.422342:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622869.422358:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e07284600/0xef842f43731d673e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6737 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.422507:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e07284600/0xef842f43731d673e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6737 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.422521:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e07284600/0xef842f43731d673e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6737 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.422532:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284600, rc 0) 00000100:00100000:1.0:1788622869.422583:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866714368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.422590:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:2.0:1788622869.422787:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622869.422899:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866714368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622869.422916:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.422927:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622869.422985:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866714496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.423012:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.423039:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.423141:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714496 00000100:00100000:1.0:1788622869.423146:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714496 00000100:00100000:1.0:1788622869.423236:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788622869.423243:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866714496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.423821:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866714496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 576us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.423829:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788622869.423957:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866714496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.423995:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866714624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.424041:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.424072:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.424252:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714624 00000100:00100000:1.0:1788622869.424257:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714624 00000100:00100000:1.0:1788622869.424324:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788622869.424333:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866714624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.424787:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866714624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 454us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.424801:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788622869.424879:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866714624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.426000:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8436:1875506866714752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622869.426077:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.426278:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.426323:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714752 00000100:00100000:2.0:1788622869.426332:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714752 00000100:00100000:2.0:1788622869.426489:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788622869.426500:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:8436:x1875506866714752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622869.426894:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:8436:x1875506866714752:12345-0@lo:502:llog_process_th.0 Request processed in 395us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.426902:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788622869.427005:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8436:1875506866714752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788622869.427043:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622869.427055:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622869.427058:0:8436:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788622869.427065:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788622869.427108:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8436:1875506866714880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622869.427148:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.427574:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.427869:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866714880 00000100:00100000:1.0:1788622869.427876:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866714880 00000100:00100000:1.0:1788622869.427917:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788622869.427925:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:8436:x1875506866714880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622869.428899:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:8436:x1875506866714880:12345-0@lo:502:llog_process_th.0 Request processed in 968us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.428912:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788622869.429313:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8436:1875506866714880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788622869.429356:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622869.429365:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622869.429367:0:8436:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788622869.429372:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788622869.429738:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788622869.429778:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788622869.429794:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.429811:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622869.429825:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788622869.429828:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e0835b000 from 39 10000000:01000000:1.0:1788622869.429832:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788622869.429887:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.429896:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.429907:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622869.429936:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.430030:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622869.430221:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622869.430557:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715008 00000100:00100000:2.0:1788622869.430565:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715008 00000100:00100000:2.0:1788622869.430772:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788622869.430784:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866715008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622869.430800:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622869.430820:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bac800/0xef842f43731d674c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6745 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.430852:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac800/0xef842f43731d674c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6745 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.430866:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bac800/0xef842f43731d674c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6745 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622869.430892:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac800, rc 0) 00000100:00100000:2.0:1788622869.430953:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866715008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.430959:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788622869.431297:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622869.431316:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.431328:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622869.431523:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.431561:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.431882:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788622869.431953:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715136 00000100:00100000:3.0:1788622869.431960:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715136 00000100:00100000:1.0:1788622869.432118:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788622869.432129:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866715136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.432502:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866715136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.432509:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788622869.432897:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.432946:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.433003:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.433028:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.433047:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715264 00000100:00100000:0.0:1788622869.433051:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715264 00000100:00100000:0.0:1788622869.433089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788622869.433098:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866715264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.433288:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866715264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.433295:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788622869.433334:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.434265:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8437:1875506866715392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622869.434316:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.434402:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.437497:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715392 00000100:00100000:1.0:1788622869.437515:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715392 00000100:00100000:1.0:1788622869.437789:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788622869.437804:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8437:x1875506866715392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622869.438241:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8437:x1875506866715392:12345-0@lo:502:llog_process_th.0 Request processed in 439us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.438250:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788622869.439352:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8437:1875506866715392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622869.439900:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8437:1875506866715520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622869.439989:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.451219:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.453528:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715520 00000100:00100000:0.0:1788622869.453548:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715520 00000100:00100000:0.0:1788622869.454330:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788622869.454349:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8437:x1875506866715520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622869.456944:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8437:x1875506866715520:12345-0@lo:502:llog_process_th.0 Request processed in 2587us (16941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.456962:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788622869.458300:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8437:1875506866715520:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788622869.458376:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788622869.459371:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788622869.459478:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788622869.459495:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.459509:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622869.459522:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788622869.459526:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788622869.459529:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788622869.459586:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.459733:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.459796:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622869.459834:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.459926:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622869.459977:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de840 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.460326:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715648 00000100:00100000:0.0:1788622869.460337:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715648 00000100:00100000:0.0:1788622869.460490:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788622869.460502:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866715648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622869.460519:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622869.460540:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e4100e000/0xef842f43731d675a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6753 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.460577:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e4100e000/0xef842f43731d675a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6753 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.460600:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e4100e000/0xef842f43731d675a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6753 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.460612:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e4100e000, rc 0) 00000100:00100000:0.0:1788622869.460801:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866715648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.460810:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788622869.461005:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788622869.461024:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.461034:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622869.461256:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.461293:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622869.461327:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.461344:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715776 00000100:00100000:1.0:1788622869.461349:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715776 00000100:00100000:1.0:1788622869.461373:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788622869.461452:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866715776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.462045:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866715776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 663us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.462054:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788622869.463282:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622869.463365:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622869.463573:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.463597:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.463839:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866715904 00000100:00100000:0.0:1788622869.463848:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866715904 00000100:00100000:0.0:1788622869.463898:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788622869.463908:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866715904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.464297:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866715904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 389us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.464306:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788622869.465570:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866715904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622869.475967:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8438:1875506866716032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622869.476685:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.476786:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788622869.479958:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716032 00000100:00100000:1.0:1788622869.479979:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716032 00000100:00100000:1.0:1788622869.480076:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788622869.480098:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8438:x1875506866716032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622869.482555:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8438:x1875506866716032:12345-0@lo:502:llog_process_th.0 Request processed in 2449us (5928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622869.482570:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788622869.483063:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8438:1875506866716032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788622869.483128:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788622869.483141:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622869.483143:0:8438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788622869.483274:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788622869.483330:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8438:1875506866716160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622869.483484:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622869.483542:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.483610:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716160 00000100:00100000:0.0:1788622869.483690:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716160 00000100:00100000:0.0:1788622869.483790:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788622869.483802:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8438:x1875506866716160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622869.484229:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8438:x1875506866716160:12345-0@lo:502:llog_process_th.0 Request processed in 428us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.484245:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788622869.485557:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8438:1875506866716160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788622869.485609:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788622869.485948:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788622869.485952:0:8438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788622869.485959:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788622869.487215:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788622869.487253:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788622869.487272:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.487289:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622869.487306:0:5806:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788622869.487310:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff997e06120000 from 1 10000000:01000000:1.0:1788622869.487314:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788622869.487373:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.487507:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.487522:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622869.487556:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866716288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.487708:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622869.487818:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372dee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622869.487924:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716288 00000100:00100000:0.0:1788622869.487935:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716288 00000100:00100000:0.0:1788622869.488008:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788622869.488021:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866716288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622869.488040:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622869.488059:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e4100fe00/0xef842f43731d6768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6761 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.488252:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e4100fe00/0xef842f43731d6768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6761 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.488267:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e4100fe00/0xef842f43731d6768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6761 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622869.488279:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e4100fe00, rc 0) 00000100:00100000:0.0:1788622869.488338:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866716288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622869.488345:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788622869.488496:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866716288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788622869.488512:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622869.488522:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622869.488589:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866716416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622869.489239:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622869.490218:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716416 00000100:00100000:0.0:1788622869.490231:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716416 00000100:00100000:0.0:1788622869.490299:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788622869.490311:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866716416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622869.490939:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866716416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 627us (1697us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788622869.490951:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788622869.494799:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372dee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788622869.494868:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866716416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788622869.494936:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788622869.494950:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622869.494962:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622869.548210:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866716800:0@lo:400:kworker.0 00000100:00100000:3.0:1788622869.548330:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.548493:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866716544:0@lo:400:kworker.0 00000100:00100000:1.0:1788622869.548556:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866716672:0@lo:400:kworker.0 00000100:00100000:3.0:1788622869.548635:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788622869.548642:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866716928:0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.553163:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.553529:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866717056:0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.553708:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.553993:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622869.554007:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866717184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622869.554037:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.554494:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716800 00000100:00100000:2.0:1788622869.554507:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716800 00000100:00100000:2.0:1788622869.554572:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717056 00000100:00100000:2.0:1788622869.554576:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717056 00000100:00100000:2.0:1788622869.555734:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788622869.555766:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866716800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.555864:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866716800:12345-0@lo:400:kworker.0 Request processed in 107us (7535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.555871:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788622869.555895:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788622869.555903:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866717056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.555945:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866717056:12345-0@lo:400:kworker.0 Request processed in 44us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.555951:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788622869.555977:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716544 00000100:00100000:2.0:1788622869.555985:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716544 00000100:00100000:2.0:1788622869.556023:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788622869.556030:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866716544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.556065:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866716544:12345-0@lo:400:kworker.0 Request processed in 36us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.556072:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788622869.556704:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717184 00000100:00100000:2.0:1788622869.556711:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717184 00000100:00100000:2.0:1788622869.556788:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788622869.556797:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866717184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788622869.556835:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622869.556882:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866717184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.556889:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788622869.556914:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788622869.556971:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a2d3b80 x1875506866717184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622869.556998:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866717184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622869.557016:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866716544:0@lo:400:kworker.0 00010000:00080000:2.0:1788622869.557027:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9ce00 x1875506866717056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622869.557035:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866717056:0@lo:400:kworker.0 00000100:00100000:1.0:1788622869.559560:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622869.561220:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716672 00000100:00100000:2.0:1788622869.561238:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716672 00000100:00100000:2.0:1788622869.561343:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788622869.561360:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866716672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.562426:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866716672:12345-0@lo:400:kworker.0 Request processed in 1066us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.562438:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788622869.562445:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622869.562511:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866716672:0@lo:400:kworker.0 00000100:00100000:3.0:1788622869.566213:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788622869.566480:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9ed80 x1875506866716800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622869.566500:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866716800:0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.566822:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866716928 00000100:00100000:2.0:1788622869.566834:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866716928 00000100:00100000:2.0:1788622869.567549:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788622869.567564:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866716928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622869.567711:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866716928:12345-0@lo:400:kworker.0 Request processed in 150us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622869.567720:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788622869.567816:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866716928:0@lo:400:kworker.0 00000100:00080000:1.0:1788622869.574696:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788622870.445124:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788622870.822672:0:8475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffeb89e610 20000000:00000080:1.0:1788622870.822697:0:8475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997e37469800 uarg=0000000000000000 20000000:01000000:1.0:1788622870.823187:0:8475:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788622870.823197:0:8475:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788622870.823205:0:8475:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788622870.824211:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788622870.824400:0:8475:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788622870.834910:0:8475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788622870.834983:0:8475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788622870.835044:0:8475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788622870.835082:0:8475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788622870.835115:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835141:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d64dd expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835151:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d653f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835159:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d660a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835171:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835179:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835240:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835278:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 9 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622870.835299:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717312:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622870.835636:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d660a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835645:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d660a expref: 18 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622870.835656:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717440:0@lo:104: 00000100:00100000:3.0:1788622870.835701:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788622870.835739:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d653f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835775:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d653f expref: 18 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622870.835784:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717568:0@lo:104: 00000100:00100000:3.0:1788622870.835813:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788622870.835850:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d64dd expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.835858:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d64dd expref: 18 pid: 5803 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622870.835866:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717696:0@lo:104: 00000100:00100000:3.0:1788622870.835885:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622870.836427:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788622870.836454:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622870.836471:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717440 00000100:00100000:0.0:1788622870.836480:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717440 00000100:00100000:0.0:1788622870.836532:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717568 00000100:00100000:0.0:1788622870.836535:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717568 00000100:00100000:0.0:1788622870.836547:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717696 00000100:00100000:0.0:1788622870.836550:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717696 00000100:00100000:0.0:1788622870.836564:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788622870.836575:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:8475:x1875506866717440:12345-0@lo:104: 00010000:00010000:0.0:1788622870.836594:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.836669:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788622870.836677:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+5:8475:x1875506866717440:12345-0@lo:104: Request processed in 104us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622870.836686:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788622870.836708:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788622870.836715:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:8475:x1875506866717568:12345-0@lo:104: 00010000:00010000:0.0:1788622870.836724:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.836792:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788622870.836798:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:8475:x1875506866717568:12345-0@lo:104: Request processed in 84us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622870.836804:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788622870.836843:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788622870.836850:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:8475:x1875506866717696:12345-0@lo:104: 00010000:00010000:0.0:1788622870.836872:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.836914:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788622870.836919:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:8475:x1875506866717696:12345-0@lo:104: Request processed in 71us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622870.836926:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788622870.836947:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788622870.836955:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.836963:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bacc00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622870.836968:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.836979:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622870.836987:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622870.836994:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788622870.837038:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837046:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788622870.837153:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837162:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bacc00/0xef842f43731d660a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6611 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837186:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788622870.837189:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837196:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00030c00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622870.837198:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837206:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622870.837213:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622870.837218:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788622870.837234:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837241:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788622870.837248:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837255:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e00030c00/0xef842f43731d653f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6546 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837264:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622870.837268:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837283:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e00030200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788622870.837286:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837292:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788622870.837298:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622870.837302:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788622870.837317:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837322:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788622870.837340:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837347:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e00030200/0xef842f43731d64dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d64e4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.837372:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622870.837375:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622870.837377:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622870.837385:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622870.837393:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622870.837410:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866717824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788622870.837455:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622870.837503:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622870.837518:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866717952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788622870.837541:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622870.837572:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866718080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788622870.837595:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622870.837630:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717824 00000100:00100000:0.0:1788622870.837636:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717824 00010000:00010000:0.0:1788622870.837662:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d660a expref: 19 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622870.837686:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866717952 00000100:00100000:0.0:1788622870.837690:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866717952 00010000:00010000:0.0:1788622870.837701:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d653f expref: 20 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622870.837712:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718080 00000100:00100000:0.0:1788622870.837714:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718080 00010000:00010000:0.0:1788622870.837724:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d64dd expref: 21 pid: 5803 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622870.837737:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788622870.838148:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717440:0@lo:104: 00000100:00100000:3.0:1788622870.838163:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717568:0@lo:104: 00000100:00100000:3.0:1788622870.838171:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717696:0@lo:104: 00000100:00100000:1.0:1788622870.838303:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788622870.838316:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+21:3280:x1875506866717952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788622870.838334:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622870.838343:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d653f expref: 21 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.838381:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d653f expref: 21 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.838402:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fba00/0xef842f43731d6546 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d653f expref: 21 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.838420:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622870.838542:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+20:3280:x1875506866717824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788622870.838553:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622870.838559:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d660a expref: 20 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.838567:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d660a expref: 20 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.838578:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fac00/0xef842f43731d6611 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d660a expref: 20 pid: 5804 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622870.838597:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622870.838643:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866717952:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622870.838650:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788622870.838671:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788622870.838677:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3278:x1875506866718080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788622870.838685:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622870.838690:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d64dd expref: 18 pid: 5803 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.838698:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d64dd expref: 18 pid: 5803 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.838708:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e00030e00/0xef842f43731d64e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d64dd expref: 18 pid: 5803 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.838717:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622870.838917:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3278:x1875506866718080:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622870.838923:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788622870.838983:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866718080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788622870.839352:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3280:x1875506866717824:12345-0@lo:103:ldlm_bl.0 Request processed in 1608us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622870.839372:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788622870.839491:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866717952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622870.839500:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866717824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788622870.854417:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622870.854511:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301184 00000100:00100000:1.0:1788622870.854543:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301184 00010000:00010000:1.0:1788622870.854600:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 10 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622870.854657:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:1.0:1788622870.854670:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858301184:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622870.854691:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622870.854699:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 10 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854716:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 10 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854785:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854797:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854837:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854848:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854856:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854864:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854871:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788622870.854884:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854894:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854906:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622870.854919:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622870.854991:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858301184:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 323us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622870.855000:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 24 00010000:00010000:3.0:1788622870.855898:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13734800/0xef842f43731d66ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e684 expref: 9 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622870.855919:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8475:1875506866717312:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622870.855961:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.855973:0:8475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.855980:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622870.855986:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb200/0xef842f43731d676f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622871.384469:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622871.384926:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301312 00000100:00100000:0.0:1788622871.384941:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301312 00000100:00100000:0.0:1788622871.385033:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 172 00000100:00100000:0.0:1788622871.385056:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:5589:x1875506858301312:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622871.385081:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622871.385111:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6c3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622871.385164:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622871.385180:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622871.385191:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8800, rc 0) 00000100:00100000:0.0:1788622871.385266:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301312:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 223us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622871.385274:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 172 00000100:00100000:2.0:1788622871.400503:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622871.400617:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301440 00000100:00100000:1.0:1788622871.400632:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301440 00000100:00100000:1.0:1788622871.400713:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 173 00000100:00100000:1.0:1788622871.400727:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301440:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622871.401221:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301440:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 495us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622871.401231:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 173 00000100:00100000:0.0:1788622871.411817:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622871.411904:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301568 00000100:00100000:3.0:1788622871.411919:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301568 00000100:00100000:3.0:1788622871.412007:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 174 00000100:00100000:3.0:1788622871.412021:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301568:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622871.412476:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:5589:x1875506858301568:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 456us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622871.412505:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 174 00000100:00100000:2.0:1788622871.420148:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622871.422168:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301696 00000100:00100000:1.0:1788622871.422189:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301696 00000100:00100000:1.0:1788622871.422296:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 175 00000100:00100000:1.0:1788622871.422309:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:6118:x1875506858301696:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788622871.424020:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:6118:x1875506858301696:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 1702us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622871.424037:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 175 00000100:00100000:2.0:1788622871.442860:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622871.443273:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301824 00000100:00100000:3.0:1788622871.443289:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301824 00000100:00100000:3.0:1788622871.443377:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 176 00000100:00100000:3.0:1788622871.443390:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:6118:x1875506858301824:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788622871.443723:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:6118:x1875506858301824:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 334us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622871.443735:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 176 00010000:00010000:0.0:1788622871.468156:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788622871.980728:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788622871.980774:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e3ccbd000 from 4 10000000:01000000:2.0:1788622871.980780:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788622871.980853:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622871.980867:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622871.980880:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622871.980916:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788622871.981016:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622871.981100:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622871.982246:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718208 00000100:00100000:0.0:1788622871.982262:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718208 00000100:00100000:0.0:1788622871.982375:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788622871.982387:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866718208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622871.982406:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622871.982427:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d677d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622871.982464:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d677d expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622871.982477:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d677d expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622871.982488:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9200, rc 0) 00000100:00100000:0.0:1788622871.982588:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866718208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622871.982596:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788622871.982885:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622871.982909:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622871.982921:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622871.983038:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622871.983095:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622871.983153:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622871.983560:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718336 00000100:00100000:3.0:1788622871.983580:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718336 00000100:00100000:3.0:1788622871.983630:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788622871.983639:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866718336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622871.984060:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866718336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622871.984069:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788622871.984447:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622871.984506:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622871.984560:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622871.984606:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622871.984711:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718464 00000100:00100000:0.0:1788622871.984718:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718464 00000100:00100000:0.0:1788622871.984788:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788622871.984797:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866718464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622871.984996:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866718464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622871.985004:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788622871.985786:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622871.999828:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8507:1875506866718592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622871.999970:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622872.000032:0:8507:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788622872.000131:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718592 00000100:00100000:3.0:1788622872.000154:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718592 00000100:00100000:3.0:1788622872.000227:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788622872.000239:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8507:x1875506866718592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622872.000560:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8507:x1875506866718592:12345-0@lo:502:llog_process_th.0 Request processed in 322us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622872.000568:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788622872.000918:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8507:1875506866718592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788622872.000959:0:8507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788622872.000972:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622872.000975:0:8507:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788622872.000991:0:8507:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e3ccbd000 00000020:00000080:2.0:1788622872.000994:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788622872.001114:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8507:1875506866718720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622872.001178:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622872.001218:0:8507:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788622872.001282:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718720 00000100:00100000:0.0:1788622872.001288:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718720 00000100:00100000:0.0:1788622872.001344:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788622872.001353:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8507:x1875506866718720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622872.001537:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:8507:x1875506866718720:12345-0@lo:502:llog_process_th.0 Request processed in 184us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622872.001551:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788622872.002007:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8507:1875506866718720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788622872.002040:0:8507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788622872.002047:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622872.002055:0:8507:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788622872.002064:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788622872.002397:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788622872.002428:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788622872.002443:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622872.002457:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622872.002469:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788622872.002472:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e1026d000 from 4 10000000:01000000:0.0:1788622872.002476:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788622872.002520:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622872.002529:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622872.002539:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622872.002560:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788622872.002611:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622872.002655:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788622872.002819:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718848 00000100:00100000:2.0:1788622872.002827:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718848 00000100:00100000:2.0:1788622872.002867:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788622872.002877:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866718848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622872.002890:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622872.002908:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d678b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.002941:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d678b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.002954:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d678b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.002965:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788622872.003009:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866718848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622872.003016:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788622872.003059:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622872.003074:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.003307:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622872.003381:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622872.003413:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622872.003457:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788622872.003508:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866718976 00000100:00100000:0.0:1788622872.003513:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866718976 00000100:00100000:0.0:1788622872.003548:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788622872.003557:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866718976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622872.003934:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866718976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622872.003948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788622872.012420:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866718976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622872.012515:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622872.012619:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622872.012673:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788622872.012798:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719104 00000100:00100000:0.0:1788622872.012807:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719104 00000100:00100000:0.0:1788622872.012874:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788622872.012885:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866719104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622872.013187:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866719104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622872.013196:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788622872.013463:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622872.015619:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8510:1875506866719232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622872.015732:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622872.015802:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788622872.015869:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719232 00000100:00100000:0.0:1788622872.015879:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719232 00000100:00100000:0.0:1788622872.015940:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788622872.015951:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8510:x1875506866719232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622872.016260:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8510:x1875506866719232:12345-0@lo:502:llog_process_th.0 Request processed in 310us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622872.016268:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788622872.016603:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8510:1875506866719232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788622872.016645:0:8510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788622872.016657:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622872.016661:0:8510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788622872.016677:0:8510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e1026d000 00000020:00000080:2.0:1788622872.016680:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788622872.016843:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8510:1875506866719360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622872.016892:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622872.016923:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788622872.017547:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719360 00000100:00100000:0.0:1788622872.017557:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719360 00000100:00100000:0.0:1788622872.017655:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788622872.017668:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8510:x1875506866719360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622872.018023:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:8510:x1875506866719360:12345-0@lo:502:llog_process_th.0 Request processed in 356us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622872.018034:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788622872.018371:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8510:1875506866719360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788622872.018415:0:8510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788622872.018424:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622872.018426:0:8510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788622872.018439:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788622872.019455:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788622872.019488:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788622872.019503:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622872.019532:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622872.019546:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788622872.019550:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e0835b000 from 4 10000000:01000000:0.0:1788622872.019553:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788622872.019609:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622872.019619:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622872.019631:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622872.019665:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788622872.019789:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622872.019980:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08689a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788622872.020341:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719488 00000100:00100000:2.0:1788622872.020351:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719488 00000100:00100000:2.0:1788622872.020412:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788622872.020432:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866719488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622872.020450:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622872.020467:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6799 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.020501:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6799 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.020514:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6799 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.020525:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788622872.020593:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866719488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622872.020600:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788622872.022459:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788622872.022502:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622872.022519:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622872.022630:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622872.022706:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622872.022785:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622872.022833:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719616 00000100:00100000:3.0:1788622872.022842:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719616 00000100:00100000:3.0:1788622872.023061:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788622872.023085:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866719616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622872.025008:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866719616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1914us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622872.025025:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788622872.025917:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622872.026002:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788622872.026110:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622872.026352:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622872.027063:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719744 00000100:00100000:3.0:1788622872.027077:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719744 00000100:00100000:3.0:1788622872.027415:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788622872.027430:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866719744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622872.027900:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866719744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 472us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622872.027909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788622872.028578:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866719744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788622872.029380:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8513:1875506866719872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622872.029463:0:8513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622872.029850:0:8513:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788622872.036204:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866719872 00000100:00100000:2.0:1788622872.036223:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866719872 00000100:00100000:2.0:1788622872.036325:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788622872.036349:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:8513:x1875506866719872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622872.036724:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:8513:x1875506866719872:12345-0@lo:502:llog_process_th.0 Request processed in 378us (7260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622872.036733:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788622872.037569:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8513:1875506866719872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788622872.037627:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788622872.037643:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622872.037647:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788622872.037659:0:8513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e0835b000 00000020:00000080:1.0:1788622872.037662:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788622872.038582:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8513:1875506866720000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622872.038835:0:8513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622872.038881:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720000 00000100:00100000:1.0:1788622872.038890:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720000 00000100:00100000:1.0:1788622872.038946:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788622872.038957:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:8513:x1875506866720000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622872.039224:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:8513:x1875506866720000:12345-0@lo:502:llog_process_th.0 Request processed in 269us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622872.039231:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788622872.039298:0:8513:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622872.041181:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:8513:1875506866720000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788622872.041786:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788622872.041800:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622872.041803:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788622872.041811:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788622872.044853:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788622872.045100:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788622872.045120:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622872.045137:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622872.493883:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622872.792479:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622872.792527:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622872.792567:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622872.792596:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622872.792644:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302336 00000100:00100000:1.0:1788622872.792659:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302336 00000100:00100000:1.0:1788622872.792732:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302208 00000100:00100000:1.0:1788622872.792734:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302208 00000100:00100000:1.0:1788622872.792819:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:1.0:1788622872.792829:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2350:x1875506858302336:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622872.792913:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2350:x1875506858302336:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622872.792921:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:1.0:1788622872.792952:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:1.0:1788622872.792957:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2350:x1875506858302208:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622872.792979:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2350:x1875506858302208:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 21us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622872.792984:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00080000:1.0:1788622872.793000:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788622872.793004:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788622872.793235:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302080 00000100:00100000:0.0:1788622872.793240:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302080 00000100:00100000:0.0:1788622872.793286:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:0.0:1788622872.793294:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858302080:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622872.793344:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858302080:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 51us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622872.793351:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:2.0:1788622872.793609:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858301952 00000100:00100000:2.0:1788622872.793614:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858301952 00000100:00100000:2.0:1788622872.793755:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 192 00000100:00100000:2.0:1788622872.793763:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858301952:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622872.793797:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858301952:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 36us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622872.793804:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 192 00000100:00080000:1.0:1788622872.796794:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622873.131950:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622873.131985:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866720128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622873.132090:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622873.132203:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720128 00000100:00100000:3.0:1788622873.132215:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720128 00000100:00100000:3.0:1788622873.132295:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788622873.132306:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866720128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788622873.132367:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622873.132425:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866720128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622873.132433:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788622873.132459:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788622873.132636:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9ed80 x1875506866720128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622873.132675:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866720128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788622873.516646:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622874.543724:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622874.668408:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866720384:0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.668516:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622874.668710:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866720256:0@lo:400:kworker.0 00000100:00100000:3.0:1788622874.668776:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622874.668810:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866720768:0@lo:400:kworker.0 00000100:00100000:3.0:1788622874.668836:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622874.668885:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720384 00000100:00100000:3.0:1788622874.668895:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720384 00000100:00100000:3.0:1788622874.668950:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720768 00000100:00100000:3.0:1788622874.668953:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720768 00000100:00100000:3.0:1788622874.668992:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788622874.669002:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866720384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622874.669080:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866720384:12345-0@lo:400:kworker.0 Request processed in 79us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622874.669088:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788622874.669107:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788622874.669114:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866720768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622874.669147:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866720768:12345-0@lo:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622874.669152:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788622874.669170:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622874.669206:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866720768:0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669484:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866720896:0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669530:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622874.669571:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866720384:0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669594:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866720512:0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669637:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622874.669662:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788622874.669668:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866720640:0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669691:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622874.669728:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720512 00000100:00100000:1.0:1788622874.669733:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720512 00000100:00100000:1.0:1788622874.669787:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788622874.669796:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866720512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669849:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866720512:12345-0@lo:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622874.669856:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788622874.669902:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720256 00000100:00100000:1.0:1788622874.669907:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720256 00000100:00100000:1.0:1788622874.669939:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788622874.669946:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866720256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.669985:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866720256:12345-0@lo:400:kworker.0 Request processed in 39us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622874.669992:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788622874.670025:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720896 00000100:00100000:1.0:1788622874.670029:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720896 00000100:00100000:0.0:1788622874.670274:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788622874.670297:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866721024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622874.670343:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788622874.670398:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622874.670411:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721024 00000100:00100000:2.0:1788622874.670416:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721024 00000100:00100000:0.0:1788622874.670422:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866720512:0@lo:400:kworker.0 00000100:00080000:0.0:1788622874.670436:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788622874.670454:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788622874.670461:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866721024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622874.670474:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866720256:0@lo:400:kworker.0 00002000:00000024:0.0:1788622874.670524:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622874.670566:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866720640 00000100:00100000:1.0:1788622874.670570:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866720640 00000100:00100000:0.0:1788622874.670578:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866721024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622874.670585:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788622874.670734:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788622874.670776:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866720896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.670815:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866720896:12345-0@lo:400:kworker.0 Request processed in 73us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622874.670821:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788622874.670833:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788622874.670839:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866720640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622874.670873:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866720640:12345-0@lo:400:kworker.0 Request processed in 34us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622874.670879:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788622874.670950:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a316a00 x1875506866720896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622874.670963:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866720896:0@lo:400:kworker.0 00010000:00080000:2.0:1788622874.676423:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a2d0380 x1875506866721024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622874.676459:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866721024:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788622874.678089:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a315500 x1875506866720640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622874.678111:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866720640:0@lo:400:kworker.0 00010000:00010000:1.0:1788622875.563974:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622876.587853:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622877.611890:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622877.925674:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622877.925714:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622877.925778:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302592 00000100:00100000:3.0:1788622877.925789:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302592 00000100:00100000:3.0:1788622877.925863:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:3.0:1788622877.925874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858302592:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622877.925969:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858302592:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622877.925977:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00080000:3.0:1788622877.926002:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622877.926388:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622877.926429:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622877.927064:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302464 00000100:00100000:0.0:1788622877.927074:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302464 00000100:00100000:0.0:1788622877.927119:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 194 00000100:00100000:0.0:1788622877.927138:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2348:x1875506858302464:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622877.927199:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2348:x1875506858302464:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 72us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622877.927232:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 194 00000100:00100000:3.0:1788622877.927326:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302720 00000100:00100000:3.0:1788622877.927331:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302720 00000100:00100000:3.0:1788622877.927378:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302848 00000100:00100000:3.0:1788622877.927383:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302848 00000100:00100000:3.0:1788622877.927407:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:3.0:1788622877.927414:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858302720:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622877.927447:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858302720:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 34us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622877.927589:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:3.0:1788622877.927605:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788622877.927612:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858302848:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622877.927642:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858302848:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 31us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622877.927648:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00080000:1.0:1788622877.927700:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788622877.927704:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622878.255292:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622878.255319:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866721152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788622878.255399:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622878.255472:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721152 00000100:00100000:2.0:1788622878.255479:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721152 00000100:00100000:2.0:1788622878.255530:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788622878.255538:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866721152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622878.255568:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622878.255606:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866721152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622878.255627:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788622878.255646:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788622878.255674:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b49180 x1875506866721152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622878.255693:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866721152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788622878.642340:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788622878.726550:0:8776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788622879.660563:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622879.788161:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866721536:0@lo:400:kworker.0 00000100:00100000:1.0:1788622879.788281:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622879.788356:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788622879.788363:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866721664:0@lo:400:kworker.0 00000100:00100000:1.0:1788622879.788396:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622879.788446:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721664 00000100:00100000:1.0:1788622879.788455:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721664 00000100:00100000:1.0:1788622879.788518:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788622879.788528:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866721664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622879.788588:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866721664:12345-0@lo:400:kworker.0 Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622879.788595:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788622879.788648:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d0770bb80 x1875506866721664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622879.788664:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866721664:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.788811:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866721408:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.788849:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622879.788873:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866721920:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.788894:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622879.788921:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788622879.788927:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866721280:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.788961:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622879.788984:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866721792:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789009:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622879.789038:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721536 00000100:00100000:0.0:1788622879.789043:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721536 00000100:00100000:0.0:1788622879.789087:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721408 00000100:00100000:0.0:1788622879.789091:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721408 00000100:00100000:0.0:1788622879.789105:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721792 00000100:00100000:0.0:1788622879.789108:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721792 00000100:00100000:0.0:1788622879.789125:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788622879.789132:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866721536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789170:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866721536:12345-0@lo:400:kworker.0 Request processed in 39us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622879.789177:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788622879.789202:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788622879.789208:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866721408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789239:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866721408:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622879.789253:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788622879.789265:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788622879.789271:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866721792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789301:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866721792:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622879.789307:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788622879.789370:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721920 00000100:00100000:0.0:1788622879.789374:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721920 00000100:00100000:0.0:1788622879.789402:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788622879.789408:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866721920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789441:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866721920:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622879.789447:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788622879.789465:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866721280 00000100:00100000:0.0:1788622879.789469:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866721280 00000100:00100000:0.0:1788622879.789493:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788622879.789500:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866721280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789532:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866721280:12345-0@lo:400:kworker.0 Request processed in 31us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622879.789538:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1788622879.789569:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788622879.789575:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622879.789601:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866721280:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789614:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866721792:0@lo:400:kworker.0 00000100:00100000:0.0:1788622879.789623:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866721408:0@lo:400:kworker.0 00010000:00080000:0.0:1788622879.789644:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07708380 x1875506866721920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622879.789654:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866721920:0@lo:400:kworker.0 00000100:00100000:1.0:1788622879.789965:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866721536:0@lo:400:kworker.0 00000100:00100000:1.0:1788622879.790354:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788622879.790364:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866722048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622879.790403:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622879.790445:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722048 00000100:00100000:1.0:1788622879.790450:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722048 00000100:00100000:1.0:1788622879.790480:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788622879.790488:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866722048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622879.790530:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622879.790571:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866722048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622879.790585:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788622879.790621:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07708a80 x1875506866722048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622879.790637:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866722048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788622880.683935:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622881.708076:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622882.732488:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622883.057702:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622883.057930:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622883.062795:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303104 00000100:00100000:2.0:1788622883.062817:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303104 00000100:00100000:2.0:1788622883.062935:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:2.0:1788622883.062949:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858303104:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622883.063068:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858303104:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 122us (5137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622883.063076:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00080000:2.0:1788622883.063106:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622883.063211:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622883.063388:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622883.063416:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303232 00000100:00100000:2.0:1788622883.063420:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303232 00000100:00100000:2.0:1788622883.063645:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303360 00000100:00100000:2.0:1788622883.063649:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303360 00000100:00100000:2.0:1788622883.063676:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788622883.063685:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2347:x1875506858303232:12345-192.168.204.19@tcp:9:kworker.0 00000020:00000080:2.0:1788622883.063723:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d66dc 00000100:00080000:2.0:1788622883.063737:0:8422:0:(import.c:65:import_set_state_nolock()) ffff997e0847c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788622883.063815:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788622883.064805:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+2:2347:x1875506858303232:12345-192.168.204.19@tcp:9:kworker.0 Request processed in 1114us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622883.064838:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788622883.064863:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:2.0:1788622883.064872:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2347:x1875506858303360:12345-192.168.204.19@tcp:9:kworker.0 00000020:00000080:2.0:1788622883.064897:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d66e3 00000100:00080000:2.0:1788622883.064907:0:8422:0:(import.c:65:import_set_state_nolock()) ffff997e0847a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788622883.064942:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788622883.065578:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+2:2347:x1875506858303360:12345-192.168.204.19@tcp:9:kworker.0 Request processed in 482us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622883.065587:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00080000:2.0:1788622883.065627:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788622883.065632:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788622883.065715:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622883.065722:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622883.069715:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858302976 00000100:00100000:1.0:1788622883.069738:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858302976 00000100:00100000:1.0:1788622883.069852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 196 00000100:00100000:1.0:1788622883.069866:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858302976:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622883.069973:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858302976:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 110us (12284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622883.069981:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 196 00000100:00100000:3.0:1788622883.375201:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622883.375246:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866722176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622883.375459:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622883.375613:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722176 00000100:00100000:1.0:1788622883.375625:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722176 00000100:00100000:1.0:1788622883.375716:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788622883.375728:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866722176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622883.375805:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622883.375864:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866722176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622883.375871:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788622883.375935:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788622883.375973:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07708a80 x1875506866722176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622883.376019:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866722176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788622883.759381:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622884.781135:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788622884.798499:0:9021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing yml_node 00000100:00100000:1.0:1788622884.908432:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866722304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622884.908507:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622884.908586:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722304 00000100:00100000:1.0:1788622884.908594:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722304 00000100:00100000:1.0:1788622884.908654:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788622884.908673:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866722304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622884.908719:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622884.908796:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866722304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622884.908804:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788622884.908828:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788622884.908862:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d0770a680 x1875506866722304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622884.908879:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866722304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622884.909058:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866722560:0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.909104:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622884.909129:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622884.909134:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866722688:0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.909168:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622884.909201:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722560 00000100:00100000:2.0:1788622884.909205:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722560 00000100:00100000:2.0:1788622884.909233:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722688 00000100:00100000:2.0:1788622884.909236:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722688 00000100:00100000:2.0:1788622884.909258:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788622884.909264:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866722560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.909302:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866722560:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622884.909319:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788622884.909332:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788622884.909338:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866722688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.909367:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866722688:12345-0@lo:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622884.909372:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788622884.909407:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866722688:0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.909417:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866722560:0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.909594:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866722432:0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.909628:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622884.909670:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866722944:0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.909697:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622884.909717:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622884.909723:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866722816:0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.909778:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622884.909806:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722816 00000100:00100000:1.0:1788622884.909810:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722816 00000100:00100000:1.0:1788622884.909842:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788622884.909849:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866722816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.909884:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866722816:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622884.909891:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788622884.909910:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622884.909919:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722944 00000100:00100000:1.0:1788622884.909922:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722944 00000100:00100000:1.0:1788622884.909957:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788622884.909963:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866722944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.909995:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866722944:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622884.910000:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788622884.910015:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788622884.910033:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4b800 x1875506866722816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622884.910043:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866722816:0@lo:400:kworker.0 00000100:00100000:1.0:1788622884.910053:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866722944:0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.910138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866722432 00000100:00100000:2.0:1788622884.910143:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866722432 00000100:00100000:2.0:1788622884.910184:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788622884.910191:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866722432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622884.910223:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866722432:12345-0@lo:400:kworker.0 Request processed in 33us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622884.910229:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788622884.910327:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866722432:0@lo:400:kworker.0 00010000:00010000:3.0:1788622885.804033:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622886.828480:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788622887.028728:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:0.0:1788622887.028786:0:7614:0:(genops.c:885:class_export_put()) final put ffff997e0847d000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:2.0:1788622887.029436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e0847d000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb for lustre-OST0001 00000020:00000080:2.0:1788622887.029506:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e0847a800 for lustre-OST0001 00000001:00100000:1.0:1788622887.037062:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:1.0:1788622887.037076:0:6680:0:(genops.c:885:class_export_put()) final put ffff997e0847a000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:0.0:1788622887.037964:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff997e0847a000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb for lustre-OST0000 00000020:00000080:0.0:1788622887.038037:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e0847c000 for lustre-OST0000 00010000:00010000:0.0:1788622887.852051:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622888.163446:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622888.163518:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622888.163797:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303616 00000100:00100000:3.0:1788622888.163812:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303616 00000100:00100000:3.0:1788622888.163907:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:3.0:1788622888.163922:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858303616:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622888.164039:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858303616:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 121us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622888.164049:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:0.0:1788622888.164675:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303488 00000100:00100000:0.0:1788622888.164684:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303488 00000100:00100000:0.0:1788622888.164777:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 198 00000100:00100000:0.0:1788622888.164787:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858303488:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622888.164836:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858303488:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 51us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622888.164845:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 198 00000100:00080000:1.0:1788622888.164867:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622888.492307:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866723072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788622888.492419:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622888.492573:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723072 00000100:00100000:1.0:1788622888.492584:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723072 00000100:00100000:1.0:1788622888.492677:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788622888.492690:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866723072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622888.492770:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622888.492834:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866723072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622888.492842:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788622888.493214:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788622888.493257:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07709f80 x1875506866723072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622888.493306:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866723072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788622888.876162:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788622889.641559:0:9215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:2.0:1788622889.900002:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622890.028656:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866723200:0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.028791:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622890.028868:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866723712:0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.028900:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622890.028932:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788622890.028939:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866723584:0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.028967:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622890.029018:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723712 00000100:00100000:2.0:1788622890.029028:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723712 00000100:00100000:2.0:1788622890.029115:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788622890.029126:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866723712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.029188:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866723712:12345-0@lo:400:kworker.0 Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622890.029196:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788622890.029224:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723584 00000100:00100000:2.0:1788622890.029227:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723584 00000100:00100000:2.0:1788622890.029258:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788622890.029265:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866723584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.029296:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866723584:12345-0@lo:400:kworker.0 Request processed in 32us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622890.029303:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788622890.029320:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788622890.029325:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788622890.029392:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9df80 x1875506866723584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622890.029410:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866723584:0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.029425:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866723712:0@lo:400:kworker.0 00000100:00100000:3.0:1788622890.029598:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723200 00000100:00100000:3.0:1788622890.029603:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723200 00000100:00100000:3.0:1788622890.029645:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788622890.029654:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866723200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622890.029700:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866723200:12345-0@lo:400:kworker.0 Request processed in 48us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622890.029706:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788622890.029855:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866723200:0@lo:400:kworker.0 00000100:00100000:0.0:1788622890.030012:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866723328:0@lo:400:kworker.0 00000100:00100000:0.0:1788622890.030069:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622890.030108:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866723840:0@lo:400:kworker.0 00000100:00100000:0.0:1788622890.030134:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622890.030156:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788622890.030163:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866723456:0@lo:400:kworker.0 00000100:00100000:0.0:1788622890.030187:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622890.030219:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866723968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622890.030243:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622890.030294:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723968 00000100:00100000:0.0:1788622890.030298:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723968 00000100:00100000:0.0:1788622890.030336:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788622890.030343:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866723968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788622890.030384:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622890.030427:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866723968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622890.030434:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788622890.030463:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a2d3800 x1875506866723968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622890.030479:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866723968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622890.030602:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723328 00000100:00100000:3.0:1788622890.030606:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723328 00000100:00100000:3.0:1788622890.030643:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723456 00000100:00100000:3.0:1788622890.030646:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723456 00000100:00100000:3.0:1788622890.030669:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788622890.030678:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866723328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622890.030727:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866723328:12345-0@lo:400:kworker.0 Request processed in 51us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622890.030777:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788622890.030791:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788622890.030797:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866723456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622890.030840:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866723456:12345-0@lo:400:kworker.0 Request processed in 44us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622890.030847:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788622890.031993:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866723840 00000100:00100000:2.0:1788622890.032006:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866723840 00000100:00100000:2.0:1788622890.032062:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788622890.032072:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866723840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622890.032161:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866723840:12345-0@lo:400:kworker.0 Request processed in 91us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622890.032168:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788622890.032203:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788622890.032209:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788622890.032514:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866723456:0@lo:400:kworker.0 00000100:00100000:0.0:1788622890.032529:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866723328:0@lo:400:kworker.0 00010000:00080000:0.0:1788622890.032543:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ee9d500 x1875506866723840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622890.032554:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866723840:0@lo:400:kworker.0 00010000:00010000:0.0:1788622890.923868:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622891.949046:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788622892.527461:0:9312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:2.0:1788622892.972437:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622893.273722:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622893.273818:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622893.273862:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303744 00000100:00100000:3.0:1788622893.273999:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303744 00000100:00100000:3.0:1788622893.274085:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 200 00000100:00100000:3.0:1788622893.274102:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858303744:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622893.274272:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858303744:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 173us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622893.274283:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 200 00000100:00100000:0.0:1788622893.278247:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858303872 00000100:00100000:0.0:1788622893.278268:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858303872 00000100:00080000:3.0:1788622893.278371:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622893.278401:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:0.0:1788622893.278416:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858303872:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622893.278629:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858303872:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 212us (4915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622893.278651:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:2.0:1788622893.616837:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866724096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788622893.617695:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622893.617873:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724096 00000100:00100000:2.0:1788622893.617882:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724096 00000100:00100000:2.0:1788622893.617961:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788622893.617972:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866724096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622893.618696:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622893.618789:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866724096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 818us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622893.618797:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788622893.618819:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788622893.618866:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4a680 x1875506866724096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622893.618889:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866724096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788622893.995892:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622895.022288:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788622895.083499:0:9410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:3.0:1788622895.150191:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866724224:0@lo:400:kworker.0 00000100:00100000:3.0:1788622895.150298:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622895.150365:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866724736:0@lo:400:kworker.0 00000100:00100000:3.0:1788622895.150398:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622895.150430:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788622895.150436:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866724608:0@lo:400:kworker.0 00000100:00100000:3.0:1788622895.150463:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622895.150613:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724224 00000100:00100000:2.0:1788622895.150624:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724224 00000100:00100000:2.0:1788622895.150850:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788622895.150864:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866724224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622895.150943:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866724224:12345-0@lo:400:kworker.0 Request processed in 82us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622895.150951:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788622895.150991:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724736 00000100:00100000:2.0:1788622895.150995:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724736 00000100:00100000:2.0:1788622895.151063:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788622895.151072:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866724736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622895.151109:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866724736:12345-0@lo:400:kworker.0 Request processed in 39us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622895.151117:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788622895.151140:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724608 00000100:00100000:2.0:1788622895.151143:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724608 00000100:00100000:2.0:1788622895.151172:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788622895.151178:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866724608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622895.151341:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866724608:12345-0@lo:400:kworker.0 Request processed in 163us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622895.151349:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788622895.151457:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866724352:0@lo:400:kworker.0 00000100:00100000:0.0:1788622895.151494:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622895.151517:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866724864:0@lo:400:kworker.0 00000100:00100000:0.0:1788622895.151540:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622895.151563:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622895.151570:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866724480:0@lo:400:kworker.0 00000100:00100000:0.0:1788622895.151594:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622895.151627:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724352 00000100:00100000:0.0:1788622895.151632:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724352 00000100:00100000:0.0:1788622895.151657:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724480 00000100:00100000:0.0:1788622895.151660:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724480 00000100:00100000:0.0:1788622895.151677:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788622895.151683:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866724352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622895.151722:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866724352:12345-0@lo:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622895.151728:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788622895.151760:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788622895.151768:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866724480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622895.151794:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866724480:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622895.151800:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788622895.151847:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866724480:0@lo:400:kworker.0 00000100:00100000:0.0:1788622895.151859:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866724352:0@lo:400:kworker.0 00000100:00080000:3.0:1788622895.152144:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788622895.152150:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622895.152832:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724864 00000100:00100000:3.0:1788622895.152842:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724864 00000100:00100000:3.0:1788622895.152908:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788622895.152920:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866724864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622895.152997:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866724864:12345-0@lo:400:kworker.0 Request processed in 81us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622895.153004:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788622895.153038:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788622895.153073:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f2cce00 x1875506866724864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622895.153086:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866724864:0@lo:400:kworker.0 00010000:00080000:3.0:1788622895.153125:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f2ced80 x1875506866724608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622895.153134:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866724608:0@lo:400:kworker.0 00000100:00100000:3.0:1788622895.153147:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866724224:0@lo:400:kworker.0 00000100:00100000:3.0:1788622895.153159:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866724736:0@lo:400:kworker.0 00000100:00100000:1.0:1788622895.153438:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866724992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622895.153483:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622895.153529:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866724992 00000100:00100000:1.0:1788622895.153534:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866724992 00000100:00100000:1.0:1788622895.153568:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788622895.153576:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866724992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622895.153614:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622895.153657:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866724992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622895.153664:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788622895.153695:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d0770ad80 x1875506866724992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622895.153710:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866724992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788622896.045514:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788622896.865546:0:9458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 11:41:35 EDT 2026 00010000:00010000:0.0:1788622897.068875:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622898.097707:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622898.401511:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622898.401561:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622898.401617:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304000 00000100:00100000:3.0:1788622898.401627:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304000 00000100:00100000:3.0:1788622898.401681:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 202 00000100:00100000:3.0:1788622898.401691:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858304000:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622898.401956:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2349:x1875506858304000:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 254us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622898.401965:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 202 00000100:00100000:2.0:1788622898.402465:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304128 00000100:00100000:2.0:1788622898.402472:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304128 00000100:00100000:2.0:1788622898.402584:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:2.0:1788622898.402592:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858304128:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622898.402634:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858304128:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 44us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622898.402641:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00080000:3.0:1788622898.402687:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622898.733102:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788622898.733127:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866725120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788622898.733201:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622898.733848:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725120 00000100:00100000:2.0:1788622898.733857:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725120 00000100:00100000:2.0:1788622898.733925:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788622898.733935:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866725120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622898.733982:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622898.734061:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866725120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622898.734068:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788622898.734108:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4a680 x1875506866725120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622898.734128:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866725120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788622898.738714:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788622899.116919:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622900.140728:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622900.271246:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866725248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622900.271348:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622900.271486:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725248 00000100:00100000:0.0:1788622900.271498:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725248 00000100:00100000:0.0:1788622900.271568:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788622900.271579:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866725248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788622900.271630:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622900.271685:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866725248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622900.271693:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788622900.271716:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788622900.271772:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07709880 x1875506866725248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622900.271811:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866725248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622900.272277:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866725376:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272324:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622900.272356:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866725888:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272382:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622900.272420:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788622900.272425:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866725504:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272449:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622900.272482:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725376 00000100:00100000:1.0:1788622900.272487:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725376 00000100:00100000:1.0:1788622900.272520:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788622900.272528:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866725376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272565:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866725376:12345-0@lo:400:kworker.0 Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622900.272572:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788622900.272606:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725888 00000100:00100000:1.0:1788622900.272610:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725888 00000100:00100000:1.0:1788622900.272641:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725504 00000100:00100000:1.0:1788622900.272644:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725504 00000100:00100000:1.0:1788622900.272664:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788622900.272669:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866725888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272700:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866725888:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622900.272706:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788622900.272719:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788622900.272725:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866725504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272773:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866725504:12345-0@lo:400:kworker.0 Request processed in 48us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622900.272779:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788622900.272831:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866725504:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272840:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866725376:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272861:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866725888:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272893:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866725632:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272919:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622900.272937:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788622900.272943:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866725760:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.272966:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622900.272990:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725632 00000100:00100000:1.0:1788622900.272993:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725632 00000100:00100000:1.0:1788622900.273017:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788622900.273023:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866725632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.273054:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866725632:12345-0@lo:400:kworker.0 Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622900.273061:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788622900.273078:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866725760 00000100:00100000:1.0:1788622900.273647:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866725760 00000100:00100000:1.0:1788622900.273697:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788622900.273705:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866725760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.273771:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866725760:12345-0@lo:400:kworker.0 Request processed in 67us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622900.273778:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788622900.273832:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07708380 x1875506866725760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622900.273845:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866725760:0@lo:400:kworker.0 00000100:00100000:1.0:1788622900.273859:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866725632:0@lo:400:kworker.0 00000100:00080000:1.0:1788622900.273883:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788622900.273899:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788622901.164185:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622902.188725:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622903.212836:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622903.513892:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622903.513938:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304256 00000100:00100000:3.0:1788622903.513948:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304256 00000100:00100000:3.0:1788622903.514010:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 204 00000100:00100000:3.0:1788622903.514020:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2348:x1875506858304256:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622903.514096:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2348:x1875506858304256:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622903.514104:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 204 00000100:00100000:0.0:1788622903.522460:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622903.522500:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304384 00000100:00100000:0.0:1788622903.522510:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304384 00000100:00100000:0.0:1788622903.522572:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00100000:0.0:1788622903.522582:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858304384:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622903.522657:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858304384:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622903.522665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00080000:0.0:1788622903.522695:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622903.852593:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866726016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788622903.852711:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622903.852877:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726016 00000100:00100000:0.0:1788622903.852887:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726016 00000100:00100000:0.0:1788622903.852969:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788622903.852979:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866726016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788622903.853021:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622903.853077:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866726016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622903.853085:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788622903.853129:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4a680 x1875506866726016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622903.853152:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866726016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788622903.853261:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788622904.237207:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622905.260778:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622905.388177:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866726400:0@lo:400:kworker.0 00000100:00100000:1.0:1788622905.388247:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622905.388322:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788622905.388330:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866726528:0@lo:400:kworker.0 00000100:00100000:1.0:1788622905.388355:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622905.388390:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726400 00000100:00100000:1.0:1788622905.388397:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726400 00000100:00100000:1.0:1788622905.388446:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788622905.388456:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866726400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622905.388502:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866726400:12345-0@lo:400:kworker.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622905.388509:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788622905.388767:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866726144:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.388819:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622905.388844:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866726656:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.388867:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622905.388887:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788622905.388893:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866726272:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.388914:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622905.388942:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866726784:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.388963:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622905.388990:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726144 00000100:00100000:2.0:1788622905.388995:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726144 00000100:00100000:2.0:1788622905.389037:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788622905.389044:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866726144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389080:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866726144:12345-0@lo:400:kworker.0 Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622905.389087:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788622905.389112:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726656 00000100:00100000:2.0:1788622905.389116:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726656 00000100:00100000:2.0:1788622905.389137:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726272 00000100:00100000:2.0:1788622905.389140:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726272 00000100:00100000:2.0:1788622905.389154:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788622905.389160:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866726656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389189:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866726656:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622905.389194:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788622905.389205:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788622905.389210:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866726272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389235:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866726272:12345-0@lo:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622905.389241:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788622905.389259:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726528 00000100:00100000:2.0:1788622905.389263:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726528 00000100:00100000:2.0:1788622905.389289:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726784 00000100:00100000:2.0:1788622905.389292:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726784 00000100:00100000:2.0:1788622905.389312:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788622905.389325:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866726528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389356:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866726528:12345-0@lo:400:kworker.0 Request processed in 33us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622905.389362:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788622905.389373:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788622905.389378:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866726784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389401:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866726784:12345-0@lo:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622905.389406:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788622905.389444:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866726272:0@lo:400:kworker.0 00010000:00080000:2.0:1788622905.389455:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f5c00 x1875506866726784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622905.389465:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866726784:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389472:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866726144:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.389479:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866726656:0@lo:400:kworker.0 00000100:00080000:0.0:1788622905.390908:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788622905.390917:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788622905.390920:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622905.392136:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788622905.392164:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866726912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622905.392235:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788622905.392969:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f4a80 x1875506866726528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622905.392986:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866726528:0@lo:400:kworker.0 00000100:00100000:0.0:1788622905.393003:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866726400:0@lo:400:kworker.0 00000100:00100000:2.0:1788622905.393110:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866726912 00000100:00100000:2.0:1788622905.393118:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866726912 00000100:00100000:2.0:1788622905.393174:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788622905.393183:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866726912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788622905.393222:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622905.394735:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866726912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1545us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622905.394767:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788622905.395170:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b48700 x1875506866726912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622905.395195:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866726912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788622906.283909:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622907.309572:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622908.333680:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622908.637188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622908.637307:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622908.637687:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304640 00000100:00100000:2.0:1788622908.637712:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304640 00000100:00100000:2.0:1788622908.637841:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:3.0:1788622908.637926:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858304640:12345-192.168.204.19@tcp:400:kworker.0 00000100:00080000:0.0:1788622908.637959:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622908.638012:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858304640:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 162us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622908.638020:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:1.0:1788622908.638235:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304512 00000100:00100000:1.0:1788622908.638241:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304512 00000100:00100000:1.0:1788622908.638278:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 206 00000100:00100000:1.0:1788622908.638286:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858304512:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622908.638330:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858304512:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 46us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622908.638337:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 206 00000100:00100000:3.0:1788622908.973276:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788622908.973384:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866727040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622908.973480:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622908.974487:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727040 00000100:00100000:2.0:1788622908.974500:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727040 00000100:00100000:2.0:1788622908.974604:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788622908.974624:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866727040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622908.974666:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622908.974765:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866727040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622908.974772:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788622908.974869:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b48700 x1875506866727040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622908.974909:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866727040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788622908.976862:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788622909.356868:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622910.380121:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622910.512908:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866727296:0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.512984:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622910.513057:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866727808:0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.513083:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622910.513111:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788622910.513118:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866727168:0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.513145:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622910.513179:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866727680:0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.513203:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622910.513212:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727296 00000100:00100000:0.0:1788622910.513221:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727296 00000100:00100000:3.0:1788622910.513229:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727808 00000100:00100000:3.0:1788622910.513233:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727808 00000100:00100000:0.0:1788622910.513264:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727680 00000100:00100000:0.0:1788622910.513267:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727680 00000100:00100000:3.0:1788622910.513269:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788622910.513278:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866727808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.513328:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866727808:12345-0@lo:400:kworker.0 Request processed in 51us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622910.513335:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788622910.513360:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727168 00000100:00100000:3.0:1788622910.513364:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727168 00000100:00100000:3.0:1788622910.513389:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788622910.513395:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866727168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.513425:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866727168:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622910.513432:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788622910.513514:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866727424:0@lo:400:kworker.0 00000100:00100000:0.0:1788622910.513530:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788622910.513539:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866727296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622910.513543:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622910.513559:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788622910.513564:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866727552:0@lo:400:kworker.0 00000100:00100000:0.0:1788622910.513571:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866727296:12345-0@lo:400:kworker.0 Request processed in 35us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622910.513582:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622910.514004:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866727936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622910.514031:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622910.514237:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727552 00000100:00100000:2.0:1788622910.514243:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727552 00000100:00100000:2.0:1788622910.514281:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788622910.514289:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866727552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622910.514330:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866727552:12345-0@lo:400:kworker.0 Request processed in 43us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622910.514337:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788622910.514356:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727936 00000100:00100000:2.0:1788622910.514359:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727936 00000100:00100000:2.0:1788622910.514383:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788622910.514389:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866727936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788622910.514416:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622910.514447:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866727936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622910.514454:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788622910.514489:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4a680 x1875506866727936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622910.514508:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866727936:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788622910.514535:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f2cdc00 x1875506866727552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622910.514544:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866727552:0@lo:400:kworker.0 00000100:00100000:2.0:1788622910.516120:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866727424 00000100:00100000:2.0:1788622910.516137:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866727424 00000100:00100000:3.0:1788622910.516241:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788622910.516254:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866727680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.516325:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866727680:12345-0@lo:400:kworker.0 Request processed in 76us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622910.516333:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788622910.516387:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866727168:0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.516401:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866727680:0@lo:400:kworker.0 00010000:00080000:3.0:1788622910.516415:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f2cf100 x1875506866727808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622910.516444:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866727808:0@lo:400:kworker.0 00000100:00100000:3.0:1788622910.516468:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866727296:0@lo:400:kworker.0 00000100:00100000:0.0:1788622910.518003:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788622910.518045:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788622910.518052:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788622910.518055:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788622910.518535:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788622910.518549:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866727424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622910.518814:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866727424:12345-0@lo:400:kworker.0 Request processed in 270us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622910.518822:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788622910.518933:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866727424:0@lo:400:kworker.0 00010000:00010000:0.0:1788622911.404978:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622912.427917:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622913.458158:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622913.754314:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622913.754373:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622913.754481:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304768 00000100:00100000:1.0:1788622913.754492:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304768 00000100:00100000:1.0:1788622913.754564:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 208 00000100:00100000:1.0:1788622913.754575:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858304768:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622913.754647:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858304768:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622913.754655:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 208 00000100:00100000:3.0:1788622913.756469:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858304896 00000100:00100000:3.0:1788622913.756486:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858304896 00000100:00100000:3.0:1788622913.756575:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:3.0:1788622913.756585:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858304896:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622913.756658:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858304896:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 75us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622913.756665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00080000:1.0:1788622913.757406:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788622913.823169:0:10088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:41:52 (1788622912) === 00000100:00100000:0.0:1788622914.092345:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622914.093804:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622914.093889:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622914.094037:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728064 00000100:00100000:2.0:1788622914.094046:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728064 00000100:00100000:2.0:1788622914.094125:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788622914.094135:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866728064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622914.094176:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622914.094233:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866728064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.094240:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788622914.094294:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788622914.094371:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4a680 x1875506866728064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622914.094395:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622914.238917:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.239020:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305024 00000100:00100000:3.0:1788622914.239034:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305024 00000100:00100000:3.0:1788622914.239105:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 209 00000100:00100000:3.0:1788622914.239118:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:8120:x1875506858305024:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788622914.239141:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622914.239167:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fa200/0xef842f43731d67a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6ca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622914.239208:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fa200/0xef842f43731d67a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6ca expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622914.239223:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fa200/0xef842f43731d67a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6ca expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622914.239256:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fa200, rc 0) 00000100:00100000:3.0:1788622914.239348:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8120:x1875506858305024:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 232us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622914.239358:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 209 00000100:00100000:3.0:1788622914.243966:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622914.244402:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305152 00000100:00100000:1.0:1788622914.244419:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305152 00000100:00100000:1.0:1788622914.244504:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 210 00000100:00100000:1.0:1788622914.244528:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8120:x1875506858305152:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788622914.245421:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8120:x1875506858305152:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 902us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622914.245446:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 210 00000100:00100000:1.0:1788622914.260000:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.263625:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305280 00000100:00100000:3.0:1788622914.263644:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305280 00000100:00100000:3.0:1788622914.263736:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 211 00000100:00100000:3.0:1788622914.263771:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8120:x1875506858305280:12345-192.168.204.19@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788622914.264082:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8120:x1875506858305280:12345-192.168.204.19@tcp:503:mount.lustre.0 Request processed in 313us (4093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622914.264091:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 211 00000100:00100000:0.0:1788622914.270703:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622914.270898:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305408 00000100:00100000:1.0:1788622914.270912:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305408 00000100:00100000:1.0:1788622914.270992:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 212 00000100:00100000:1.0:1788622914.271005:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8124:x1875506858305408:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788622914.271504:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8124:x1875506858305408:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 500us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622914.271524:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 212 00000100:00100000:0.0:1788622914.305619:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622914.305732:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305536 00000100:00100000:2.0:1788622914.305790:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305536 00000100:00100000:2.0:1788622914.305871:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 213 00000100:00100000:2.0:1788622914.305882:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8124:x1875506858305536:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788622914.306239:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8124:x1875506858305536:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 357us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.306248:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 213 00000100:00100000:0.0:1788622914.314203:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.314441:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305664 00000100:00100000:3.0:1788622914.314455:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305664 00000100:00100000:3.0:1788622914.314537:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 214 00000100:00100000:3.0:1788622914.314550:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:8120:x1875506858305664:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788622914.314575:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622914.314600:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fb200/0xef842f43731d67ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6f4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622914.314640:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb200/0xef842f43731d67ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6f4 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622914.314655:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fb200/0xef842f43731d67ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6f4 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622914.314687:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fb200, rc 0) 00000100:00100000:3.0:1788622914.314936:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:8120:x1875506858305664:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 387us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622914.314945:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 214 00000100:00100000:0.0:1788622914.321945:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622914.322061:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305792 00000100:00100000:1.0:1788622914.322077:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305792 00000100:00100000:1.0:1788622914.322149:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 215 00000100:00100000:1.0:1788622914.322162:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:8120:x1875506858305792:12345-192.168.204.19@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788622914.322199:0:5801:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788622914.322239:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788622914.322244:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788622914.322248:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788622914.322250:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788622914.324297:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:8120:x1875506858305792:12345-192.168.204.19@tcp:256:mount.lustre.0 Request processed in 2125us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622914.324314:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 215 00000100:00100000:0.0:1788622914.331458:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622914.333713:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858305920 00000100:00100000:2.0:1788622914.333733:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858305920 00000100:00100000:2.0:1788622914.333890:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 216 00000100:00100000:2.0:1788622914.333904:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:8120:x1875506858305920:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788622914.333928:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622914.333952:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e6fb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622914.333992:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622914.334005:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622914.334017:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad000, rc 0) 00000100:00100000:2.0:1788622914.334110:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8120:x1875506858305920:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 208us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.334119:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 216 00000100:00100000:0.0:1788622914.336417:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.336550:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306048 00000100:00100000:3.0:1788622914.336571:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306048 00000100:00100000:3.0:1788622914.336630:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 217 00000100:00100000:3.0:1788622914.336642:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8120:x1875506858306048:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788622914.344209:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8120:x1875506858306048:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 7554us (7792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.344226:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 217 00000100:00100000:0.0:1788622914.354088:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.358334:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306176 00000100:00100000:3.0:1788622914.358353:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306176 00000100:00100000:2.0:1788622914.358614:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 218 00000100:00100000:2.0:1788622914.358627:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8120:x1875506858306176:12345-192.168.204.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788622914.358934:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8120:x1875506858306176:12345-192.168.204.19@tcp:503:mount.lustre.0 Request processed in 309us (4863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.358944:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 218 00000100:00100000:0.0:1788622914.365098:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622914.365533:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306304 00000100:00100000:2.0:1788622914.365629:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306304 00000100:00100000:2.0:1788622914.365695:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 219 00000100:00100000:2.0:1788622914.365706:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8129:x1875506858306304:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788622914.367306:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8129:x1875506858306304:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 1588us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.367320:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 219 00000100:00100000:0.0:1788622914.375254:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622914.376045:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306432 00000100:00100000:2.0:1788622914.376059:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306432 00000100:00100000:2.0:1788622914.376136:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 220 00000100:00100000:2.0:1788622914.376148:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8129:x1875506858306432:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788622914.376457:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:8129:x1875506858306432:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 311us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.376466:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 220 00000100:00100000:0.0:1788622914.391620:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.391727:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306560 00000100:00100000:3.0:1788622914.391737:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306560 00000100:00100000:2.0:1788622914.392144:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788622914.392155:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1875506858306560:12345-192.168.204.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788622914.392189:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab@192.168.204.19@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1788622914.392304:0:6676:0:(genops.c:1385:class_connect()) connect: client 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab, cookie 0xef842f43731d67bc 00000004:00100000:2.0:1788622914.392344:0:6676:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788622914.392644:0:6676:0:(import.c:65:import_set_state_nolock()) ffff997e0847d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622914.392724:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2347:x1875506858306560:12345-192.168.204.19@tcp:38:mount.lustre.0 Request processed in 568us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.392733:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:0.0:1788622914.406589:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.407016:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306688 00000100:00100000:3.0:1788622914.407028:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306688 00000100:00100000:3.0:1788622914.407162:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788622914.407179:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:0:x1875506858306688:12345-192.168.204.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788622914.407241:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788622914.407351:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:0:x1875506858306688:12345-192.168.204.19@tcp:41:mount.lustre.0 Request processed in 179us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622914.407358:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:0.0:1788622914.407521:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00080000:1.0:1788622914.407570:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622914.410372:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306816 00000100:00100000:2.0:1788622914.410395:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306816 00000100:00100000:2.0:1788622914.410600:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:2.0:1788622914.410628:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:8120:x1875506858306816:12345-192.168.204.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788622914.410667:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788622914.410966:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:8120:x1875506858306816:12345-192.168.204.19@tcp:41:mount.lustre.0 Request processed in 339us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.410974:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:0.0:1788622914.413415:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622914.413531:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858306944 00000100:00100000:2.0:1788622914.413544:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858306944 00000100:00100000:2.0:1788622914.413605:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:2.0:1788622914.413616:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:8120:x1875506858306944:12345-192.168.204.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788622914.413727:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:8120:x1875506858306944:12345-192.168.204.19@tcp:40:mount.lustre.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.413734:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:0.0:1788622914.416105:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622914.417264:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622914.417294:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622914.417734:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307072 00000100:00100000:3.0:1788622914.417792:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307072 00000100:00100000:3.0:1788622914.417831:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307200 00000100:00100000:3.0:1788622914.417834:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307200 00000100:00100000:3.0:1788622914.417849:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:3.0:1788622914.417857:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858307072:12345-192.168.204.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788622914.417902:0:6657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab@192.168.204.19@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1788622914.417933:0:6657:0:(genops.c:1385:class_connect()) connect: client 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab, cookie 0xef842f43731d67c3 00002000:00100000:3.0:1788622914.417945:0:6657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab/ffff997d05d7a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788622914.417955:0:6657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788622914.418261:0:6657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788622914.418291:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997d05d7e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788622914.418354:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2347:x1875506858307072:12345-192.168.204.19@tcp:8:mount.lustre.0 Request processed in 496us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622914.418361:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:3.0:1788622914.418379:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:3.0:1788622914.418383:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858307200:12345-192.168.204.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788622914.418397:0:6657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab@192.168.204.19@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1788622914.418411:0:6657:0:(genops.c:1385:class_connect()) connect: client 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab, cookie 0xef842f43731d67ca 00002000:00100000:3.0:1788622914.418416:0:6657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab/ffff997d05d7c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788622914.418444:0:6657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788622914.418570:0:6657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788622914.418583:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788622914.418605:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2347:x1875506858307200:12345-192.168.204.19@tcp:8:mount.lustre.0 Request processed in 220us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622914.418611:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:2.0:1788622914.422101:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307328 00000100:00100000:2.0:1788622914.422121:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307328 00000100:00100000:2.0:1788622914.422200:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:2.0:1788622914.422227:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:8120:x1875506858307328:12345-192.168.204.19@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788622914.422326:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788622914.422424:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:8120:x1875506858307328:12345-192.168.204.19@tcp:33:mount.lustre.0 Request processed in 212us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622914.422441:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00010000:00010000:0.0:1788622914.476171:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622915.502536:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622915.633470:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866728192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622915.633564:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622915.640942:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866728448:0@lo:400:kworker.0 00000100:00100000:2.0:1788622915.641254:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728192 00000100:00100000:2.0:1788622915.641265:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728192 00000100:00100000:2.0:1788622915.641331:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788622915.641342:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866728192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788622915.641367:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622915.641449:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866728192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (7885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622915.641456:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788622915.641938:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622915.642062:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622915.642072:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866728576:0@lo:400:kworker.0 00000100:00100000:0.0:1788622915.642098:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622915.643090:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866728320:0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643144:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622915.643181:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866728832:0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643204:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622915.643226:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788622915.643232:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866728704:0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643257:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622915.643296:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728320 00000100:00100000:3.0:1788622915.643303:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728320 00000100:00100000:3.0:1788622915.643344:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788622915.643352:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866728320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643396:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866728320:12345-0@lo:400:kworker.0 Request processed in 44us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622915.643402:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788622915.643433:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728448 00000100:00100000:3.0:1788622915.643436:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728448 00000100:00100000:3.0:1788622915.643463:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728576 00000100:00100000:3.0:1788622915.643466:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728576 00000100:00100000:3.0:1788622915.643481:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728832 00000100:00100000:3.0:1788622915.643483:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728832 00000100:00100000:3.0:1788622915.643511:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788622915.643517:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866728448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643557:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866728448:12345-0@lo:400:kworker.0 Request processed in 40us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622915.643563:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788622915.643575:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788622915.643581:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866728576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643609:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866728576:12345-0@lo:400:kworker.0 Request processed in 28us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622915.643622:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788622915.643634:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788622915.643640:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643669:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866728832:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622915.643674:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788622915.643692:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728704 00000100:00100000:3.0:1788622915.643696:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728704 00000100:00100000:3.0:1788622915.643722:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788622915.643729:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866728704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643781:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866728704:12345-0@lo:400:kworker.0 Request processed in 52us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622915.643787:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788622915.643831:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866728576:0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643845:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866728448:0@lo:400:kworker.0 00010000:00080000:3.0:1788622915.643883:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a00aa00 x1875506866728704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622915.643894:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866728704:0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643903:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866728320:0@lo:400:kworker.0 00000100:00100000:3.0:1788622915.643910:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866728832:0@lo:400:kworker.0 00010000:00080000:3.0:1788622915.643939:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f5500 x1875506866728192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622915.645063:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866728192:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788622915.645366:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788622915.645372:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788622916.526379:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622917.547931:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788622917.777122:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000001:00100000:0.0:1788622917.793592:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000001:00100000:2.0:1788622918.244726:0:5831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00010000:00010000:0.0:1788622918.571964:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622919.214260:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622919.214310:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866728960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788622919.214390:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622919.214926:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866728960 00000100:00100000:2.0:1788622919.214936:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866728960 00000100:00100000:2.0:1788622919.215017:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788622919.215030:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866728960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622919.215078:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622919.215141:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866728960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622919.215149:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788622919.215196:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b4a680 x1875506866728960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622919.215219:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866728960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788622919.215446:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788622919.597377:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622919.898617:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622919.898677:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622919.898716:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622919.898739:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622919.898797:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622919.898869:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307584 00000100:00100000:3.0:1788622919.898879:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307584 00000100:00100000:3.0:1788622919.898950:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307712 00000100:00100000:3.0:1788622919.898954:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307712 00000100:00100000:3.0:1788622919.898988:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:3.0:1788622919.898999:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858307584:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622919.899075:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858307584:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 78us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622919.899083:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:3.0:1788622919.899099:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:3.0:1788622919.899105:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858307712:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622919.899130:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858307712:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622919.899135:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00080000:0.0:1788622919.899398:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622919.899869:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307840 00000100:00100000:3.0:1788622919.899875:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307840 00000100:00100000:1.0:1788622919.899964:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307968 00000100:00100000:1.0:1788622919.899970:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307968 00000100:00100000:3.0:1788622919.902056:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:3.0:1788622919.902071:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858307840:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622919.902150:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858307840:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 81us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622919.902158:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00080000:0.0:1788622919.902709:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788622919.902715:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622919.902835:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858307456 00000100:00100000:2.0:1788622919.902844:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858307456 00000100:00100000:2.0:1788622919.903050:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 222 00000100:00100000:2.0:1788622919.903060:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858307456:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622919.903105:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858307456:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 47us (4388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622919.903112:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 222 00000100:00100000:1.0:1788622919.903204:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:1.0:1788622919.903214:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858307968:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622919.903244:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858307968:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 32us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622919.903250:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 34 00000001:02000400:3.0:1788622920.227704:0:10285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788622920.619958:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622920.748796:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866729088:0@lo:400:kworker.0 00000100:00100000:2.0:1788622920.748883:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622920.749113:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729088 00000100:00100000:1.0:1788622920.749123:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729088 00000100:00100000:1.0:1788622920.749171:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788622920.749182:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866729088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622920.749235:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866729088:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622920.749243:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788622920.749441:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866729472:0@lo:400:kworker.0 00000100:00100000:3.0:1788622920.749476:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622920.749524:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866729344:0@lo:400:kworker.0 00000100:00100000:3.0:1788622920.749560:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622920.749578:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788622920.749583:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866729216:0@lo:400:kworker.0 00000100:00100000:3.0:1788622920.749604:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622920.749620:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866729728:0@lo:400:kworker.0 00000100:00100000:3.0:1788622920.749638:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622920.749703:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729472 00000100:00100000:3.0:1788622920.749707:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729472 00000100:00100000:3.0:1788622920.749732:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729728 00000100:00100000:3.0:1788622920.749734:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729728 00000100:00100000:3.0:1788622920.749778:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788622920.749785:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866729472:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788622920.749823:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788622920.749824:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866729472:12345-0@lo:400:kworker.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622920.749848:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788622920.749858:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788622920.749869:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866729728:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788622920.749891:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f5880 x1875506866729472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622920.749904:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866729472:0@lo:400:kworker.0 00000100:00100000:0.0:1788622920.749918:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866729728:12345-0@lo:400:kworker.0 Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622920.749924:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788622920.749954:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729344 00000100:00100000:2.0:1788622920.750879:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866729600:0@lo:400:kworker.0 00000100:00100000:2.0:1788622920.750924:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622920.751173:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729344 00000100:00100000:2.0:1788622920.751273:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866729088:0@lo:400:kworker.0 00000100:00100000:3.0:1788622920.751351:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622920.751363:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866729856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622920.751408:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622920.751448:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729856 00000100:00100000:3.0:1788622920.751454:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729856 00000100:00100000:3.0:1788622920.751485:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788622920.751492:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866729856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788622920.751526:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622920.751579:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866729856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622920.751586:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788622920.755866:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729216 00000100:00100000:1.0:1788622920.755889:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729216 00000100:00100000:1.0:1788622920.755959:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729600 00000100:00100000:1.0:1788622920.755963:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729600 00000100:00100000:1.0:1788622920.755999:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788622920.756010:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866729344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622920.756091:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866729344:12345-0@lo:400:kworker.0 Request processed in 84us (6531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622920.756098:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788622920.756113:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788622920.756132:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866729216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622920.756156:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866729216:12345-0@lo:400:kworker.0 Request processed in 25us (6550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622920.756161:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788622920.756171:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788622920.756176:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866729600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622920.756206:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866729600:12345-0@lo:400:kworker.0 Request processed in 30us (5283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622920.756212:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788622920.756339:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622920.756355:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866729216:0@lo:400:kworker.0 00010000:00080000:0.0:1788622920.756379:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f7480 x1875506866729728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622920.756403:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866729728:0@lo:400:kworker.0 00000100:00100000:0.0:1788622920.756415:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866729344:0@lo:400:kworker.0 00000100:00100000:2.0:1788622920.756610:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866729600:0@lo:400:kworker.0 00010000:00080000:2.0:1788622920.756657:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f5180 x1875506866729856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622920.756675:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866729856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788622921.644684:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622922.667948:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622923.692869:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622924.333501:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866729984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622924.333582:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622924.333778:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866729984 00000100:00100000:2.0:1788622924.333786:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866729984 00000100:00080000:1.0:1788622924.334193:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622924.335051:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788622924.335069:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866729984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622924.335111:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622924.335197:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866729984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622924.335204:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788622924.335683:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e39b48700 x1875506866729984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622924.335713:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866729984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788622924.716274:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622925.017264:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622925.017338:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622925.017377:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622925.017396:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622925.017420:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622925.017446:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308608 00000100:00100000:3.0:1788622925.017455:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308608 00000100:00100000:3.0:1788622925.017507:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308480 00000100:00100000:3.0:1788622925.017511:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308480 00000100:00100000:3.0:1788622925.017534:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:3.0:1788622925.017544:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858308608:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622925.017615:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858308608:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622925.017623:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:3.0:1788622925.017639:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:3.0:1788622925.017646:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858308480:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622925.017669:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858308480:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622925.017681:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:3.0:1788622925.017700:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308352 00000100:00100000:3.0:1788622925.017704:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308352 00000100:00100000:3.0:1788622925.017726:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308224 00000100:00100000:3.0:1788622925.017729:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308224 00000100:00100000:3.0:1788622925.017769:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:3.0:1788622925.017775:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858308352:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622925.017804:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858308352:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622925.017811:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:3.0:1788622925.017822:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:3.0:1788622925.017828:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858308224:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622925.017862:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858308224:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622925.017869:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:2.0:1788622925.018460:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308096 00000100:00100000:2.0:1788622925.018466:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308096 00000100:00100000:2.0:1788622925.018507:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 224 00000100:00100000:2.0:1788622925.018515:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858308096:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622925.018548:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858308096:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 34us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622925.018556:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 224 00000100:00080000:1.0:1788622925.019425:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788622925.019432:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788622925.019435:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788622925.740174:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622925.868106:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622925.868149:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788622925.868171:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866730496:0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.868251:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622925.868321:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866730368:0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.868358:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622925.868375:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788622925.868380:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866730240:0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.868409:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622925.868457:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730496 00000100:00100000:0.0:1788622925.868463:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730496 00000100:00100000:0.0:1788622925.868601:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730368 00000100:00100000:0.0:1788622925.868604:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730368 00000100:00100000:0.0:1788622925.868625:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788622925.868633:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866730496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.868681:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866730496:12345-0@lo:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622925.868688:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788622925.869046:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788622925.869055:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866730368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.869088:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866730368:12345-0@lo:400:kworker.0 Request processed in 35us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622925.869093:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788622925.869146:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866730368:0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.869171:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866730496:0@lo:400:kworker.0 00000100:00080000:0.0:1788622925.869200:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622925.869218:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730240 00000100:00100000:0.0:1788622925.869275:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730240 00000100:00100000:0.0:1788622925.869324:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788622925.869331:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866730240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.869363:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866730240:12345-0@lo:400:kworker.0 Request processed in 33us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622925.869378:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788622925.869410:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866730240:0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.871111:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866730624:0@lo:400:kworker.0 00000100:00100000:0.0:1788622925.871176:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622925.871347:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866730752:0@lo:400:kworker.0 00000100:00100000:2.0:1788622925.871397:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622925.871444:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622925.871450:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866730880:0@lo:400:kworker.0 00000100:00100000:2.0:1788622925.871489:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730752 00000100:00100000:2.0:1788622925.871496:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730752 00000100:00100000:2.0:1788622925.871553:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788622925.871562:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622925.871623:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866730752:12345-0@lo:400:kworker.0 Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622925.871630:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788622925.871667:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622925.872120:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622925.872228:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866730752:0@lo:400:kworker.0 00000100:00100000:1.0:1788622925.872320:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730624 00000100:00100000:1.0:1788622925.872327:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730624 00000100:00100000:1.0:1788622925.872368:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730880 00000100:00100000:1.0:1788622925.872371:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730880 00000100:00100000:1.0:1788622925.872410:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788622925.872418:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866730624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622925.872466:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866730624:12345-0@lo:400:kworker.0 Request processed in 49us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622925.872472:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788622925.872484:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788622925.872490:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866730880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622925.872519:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866730880:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622925.872538:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788622925.872557:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788622925.872594:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997d07709f80 x1875506866730624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622925.872605:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866730624:0@lo:400:kworker.0 00010000:00080000:2.0:1788622925.872861:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e1c00 x1875506866730880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622925.872870:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866730880:0@lo:400:kworker.0 00000100:00100000:3.0:1788622925.873010:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866730112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622925.873051:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622925.873134:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866730112 00000100:00100000:0.0:1788622925.873139:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866730112 00000100:00100000:0.0:1788622925.873212:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788622925.873221:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866730112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788622925.873257:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622925.873316:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866730112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622925.873322:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788622925.873376:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f5180 x1875506866730112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622925.873404:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866730112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788622926.764000:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622927.788857:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622928.811973:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622929.453278:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788622929.453305:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866731008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622929.453410:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622929.453452:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731008 00000100:00100000:1.0:1788622929.453460:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731008 00000100:00100000:1.0:1788622929.453529:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788622929.453540:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866731008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622929.453589:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622929.453638:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866731008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622929.453644:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788622929.453666:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788622929.459146:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f0f5180 x1875506866731008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622929.459184:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866731008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788622929.839560:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622930.145762:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622930.147358:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308736 00000100:00100000:2.0:1788622930.147377:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308736 00000100:00100000:2.0:1788622930.147459:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 226 00000100:00100000:2.0:1788622930.147472:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858308736:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622930.147578:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858308736:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 108us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.147587:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 226 00000100:00100000:3.0:1788622930.168840:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622930.168877:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622930.168898:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622930.169014:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308992 00000100:00100000:2.0:1788622930.169024:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308992 00000100:00100000:2.0:1788622930.169081:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858308864 00000100:00100000:2.0:1788622930.169084:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858308864 00000100:00100000:2.0:1788622930.169121:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:2.0:1788622930.169131:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858308992:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622930.171052:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858308992:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 1908us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.171067:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:2.0:1788622930.171104:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:2.0:1788622930.171120:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858308864:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622930.171167:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858308864:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 55us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.171174:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00080000:2.0:1788622930.171195:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622930.171254:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309248 00000100:00100000:2.0:1788622930.171261:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309248 00000100:00100000:2.0:1788622930.171302:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:2.0:1788622930.171310:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858309248:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622930.171337:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858309248:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 29us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.171343:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00080000:2.0:1788622930.171361:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788622930.173097:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622930.173371:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309120 00000100:00100000:2.0:1788622930.173381:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309120 00000100:00100000:2.0:1788622930.173449:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:2.0:1788622930.173460:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858309120:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622930.185144:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858309120:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 11668us (12040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.185181:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00080000:0.0:1788622930.186823:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788622930.861569:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622930.988011:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788622930.988037:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866731136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622930.988114:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622930.988184:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731136 00000100:00100000:3.0:1788622930.988202:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731136 00000100:00100000:3.0:1788622930.988258:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788622930.988267:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866731136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788622930.988310:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622930.988357:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866731136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622930.988366:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788622930.988409:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f0f5c00 x1875506866731136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622930.988441:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866731136:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788622930.988684:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788622930.992161:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866731648:0@lo:400:kworker.0 00000100:00100000:0.0:1788622930.992250:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622930.992302:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788622930.992310:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866731520:0@lo:400:kworker.0 00000100:00100000:0.0:1788622930.992336:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622930.992369:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731520 00000100:00100000:0.0:1788622930.992379:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731520 00000100:00100000:0.0:1788622930.992519:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788622930.992541:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866731520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622930.992592:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866731520:12345-0@lo:400:kworker.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622930.992599:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788622930.992626:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622930.992657:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866731520:0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.992789:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866731392:0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.992835:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622930.992869:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788622930.992876:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866731264:0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.993086:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622930.993113:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866731776:0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.993136:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622930.993167:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731264 00000100:00100000:3.0:1788622930.993171:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731264 00000100:00100000:3.0:1788622930.993219:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788622930.993226:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866731264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.993263:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866731264:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622930.993269:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788622930.993303:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866731264:0@lo:400:kworker.0 00000100:00100000:0.0:1788622930.994575:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731392 00000100:00100000:0.0:1788622930.994589:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731392 00000100:00100000:0.0:1788622930.994641:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731776 00000100:00100000:0.0:1788622930.994644:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731776 00000100:00100000:0.0:1788622930.994681:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788622930.994690:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866731392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622930.994789:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866731392:12345-0@lo:400:kworker.0 Request processed in 100us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622930.994796:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788622930.995024:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731648 00000100:00100000:2.0:1788622930.995030:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731648 00000100:00100000:2.0:1788622930.995064:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788622930.995071:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866731648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622930.995116:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866731648:12345-0@lo:400:kworker.0 Request processed in 46us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.995122:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788622930.995142:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788622930.995150:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866731776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622930.995181:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866731776:12345-0@lo:400:kworker.0 Request processed in 33us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622930.995187:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788622930.995244:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a008a80 x1875506866731648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622930.995259:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866731648:0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.996355:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866731776:0@lo:400:kworker.0 00000100:00100000:3.0:1788622930.996373:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866731392:0@lo:400:kworker.0 00000100:00080000:0.0:1788622930.997602:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788622931.891372:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622932.909616:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622933.933688:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622934.578580:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622934.578611:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866731904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788622934.578706:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622934.578818:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866731904 00000100:00100000:3.0:1788622934.578836:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866731904 00000100:00100000:3.0:1788622934.578909:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788622934.578922:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866731904:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788622934.578922:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788622934.578967:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622934.579030:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866731904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622934.579037:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788622934.579263:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e2a00 x1875506866731904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622934.579284:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866731904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788622934.957888:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622935.260490:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622935.260567:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622935.260608:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622935.260629:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309632 00000100:00100000:3.0:1788622935.260638:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309376 00000100:00100000:0.0:1788622935.260641:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309632 00000100:00100000:3.0:1788622935.260645:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309376 00000100:00080000:2.0:1788622935.260687:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622935.260693:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309760 00000100:00100000:1.0:1788622935.260700:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309760 00000100:00100000:0.0:1788622935.260721:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:3.0:1788622935.260722:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 228 00000100:00100000:2.0:1788622935.260730:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622935.260767:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2350:x1875506858309632:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622935.260769:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858309376:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622935.260776:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309888 00000100:00100000:1.0:1788622935.260782:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309888 00000100:00100000:1.0:1788622935.260811:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:1.0:1788622935.260822:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2347:x1875506858309760:12345-192.168.204.19@tcp:9:kworker.0 00000020:00000080:1.0:1788622935.260846:0:6657:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d67c3 00000100:00100000:0.0:1788622935.260851:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2350:x1875506858309632:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 115us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622935.260853:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858309376:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622935.260855:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00080000:1.0:1788622935.260871:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997d05d7e800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788622935.260872:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:3.0:1788622935.260873:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 228 00000100:00100000:0.0:1788622935.260902:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858309504 00000100:00100000:0.0:1788622935.260906:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858309504 00000001:00000004:1.0:1788622935.260919:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788622935.260941:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:3.0:1788622935.260952:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:0.0:1788622935.260953:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858309504:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622935.260966:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2347:x1875506858309888:12345-192.168.204.19@tcp:9:kworker.0 00000100:00080000:2.0:1788622935.260981:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788622935.260984:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d67ca 00000100:00080000:2.0:1788622935.260986:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788622935.260994:0:8422:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788622935.260994:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788622935.261003:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858309504:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622935.261013:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 83 00010000:00010000:2.0:1788622935.261019:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788622935.261028:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788622935.261043:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622935.261581:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+2:2347:x1875506858309760:12345-192.168.204.19@tcp:9:kworker.0 Request processed in 760us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622935.261912:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+2:2347:x1875506858309888:12345-192.168.204.19@tcp:9:kworker.0 Request processed in 949us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622935.261921:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:1.0:1788622935.262119:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00010000:00010000:0.0:1788622935.982900:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622936.113439:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866732032:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.113523:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622936.113579:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866732544:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.113607:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622936.113633:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788622936.113639:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866732160:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.113660:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622936.113677:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866732672:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.113698:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622936.113728:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866732288:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.113794:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622936.113825:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622936.113832:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866732416:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.113854:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622936.113892:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732032 00000100:00100000:3.0:1788622936.113900:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732032 00000100:00100000:3.0:1788622936.113950:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788622936.113959:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866732032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.114009:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866732032:12345-0@lo:400:kworker.0 Request processed in 51us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622936.114016:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788622936.114169:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732544 00000100:00100000:0.0:1788622936.114174:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732544 00000100:00100000:0.0:1788622936.114212:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732160 00000100:00100000:0.0:1788622936.114228:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732160 00000100:00100000:0.0:1788622936.114241:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732288 00000100:00100000:0.0:1788622936.114243:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732288 00000100:00100000:0.0:1788622936.114256:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788622936.114263:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866732544:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788622936.114280:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622936.114300:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788622936.114300:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866732544:12345-0@lo:400:kworker.0 Request processed in 38us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622936.114306:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788622936.114310:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866732160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622936.114318:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788622936.114324:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866732288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622936.114342:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866732160:12345-0@lo:400:kworker.0 Request processed in 36us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622936.114349:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788622936.114354:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866732288:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622936.114359:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788622936.114383:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732672 00000100:00100000:0.0:1788622936.114387:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732672 00000100:00100000:1.0:1788622936.114390:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866732288:0@lo:400:kworker.0 00000100:00100000:0.0:1788622936.114414:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732416 00000100:00100000:0.0:1788622936.114417:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732416 00000100:00080000:1.0:1788622936.114426:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788622936.114443:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788622936.114508:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866732160:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.114518:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866732032:0@lo:400:kworker.0 00000100:00100000:3.0:1788622936.114528:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866732544:0@lo:400:kworker.0 00000100:00100000:0.0:1788622936.114538:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788622936.114545:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866732416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622936.114584:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866732672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622936.114592:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866732416:12345-0@lo:400:kworker.0 Request processed in 49us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622936.114598:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788622936.114621:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866732672:12345-0@lo:400:kworker.0 Request processed in 171us (921us total) trans 0 rc 0/0 00000100:00080000:0.0:1788622936.114621:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622936.114627:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788622936.114689:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f0f5500 x1875506866732416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622936.114700:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866732416:0@lo:400:kworker.0 00010000:00080000:3.0:1788622936.114723:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f0f6d80 x1875506866732672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622936.114731:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866732672:0@lo:400:kworker.0 00000100:00100000:0.0:1788622936.115525:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788622936.115540:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866732800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622936.115586:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622936.115655:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732800 00000100:00100000:1.0:1788622936.115661:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732800 00000100:00100000:1.0:1788622936.115702:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788622936.115709:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866732800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622936.115779:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622936.115822:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866732800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622936.115828:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788622936.116188:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e1500 x1875506866732800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622936.116205:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866732800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788622937.004119:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622938.028422:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788622938.223353:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000020:00000080:0.0:1788622938.223365:0:7614:0:(genops.c:885:class_export_put()) final put ffff997d05d7c800/586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000020:00000080:3.0:1788622938.223481:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997d05d7c800/586e4fc9-71b3-4f30-b3e0-c9044a9b04ab for lustre-OST0001 00000020:00000080:3.0:1788622938.223546:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997d05d7d800 for lustre-OST0001 00000001:00100000:2.0:1788622938.235434:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000020:00000080:2.0:1788622938.235448:0:6680:0:(genops.c:885:class_export_put()) final put ffff997d05d7a800/586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000020:00000080:2.0:1788622938.235490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff997d05d7a800/586e4fc9-71b3-4f30-b3e0-c9044a9b04ab for lustre-OST0000 00000020:00000080:2.0:1788622938.235559:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997d05d7e800 for lustre-OST0000 00000001:02000400:2.0:1788622938.766785:0:10986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788622939.051910:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622939.693158:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622939.693201:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866732928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788622939.693300:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622939.693509:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866732928 00000100:00100000:2.0:1788622939.693519:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866732928 00000100:00100000:2.0:1788622939.693596:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788622939.693607:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866732928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788622939.693655:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788622939.693662:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622939.693714:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866732928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622939.693723:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788622939.693787:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e1f80 x1875506866732928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622939.693828:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866732928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788622940.080967:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622940.379649:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622940.379715:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622940.379806:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622940.379844:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310144 00000100:00100000:3.0:1788622940.379857:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310144 00000100:00100000:3.0:1788622940.379931:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310272 00000100:00100000:3.0:1788622940.379934:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310272 00000100:00100000:3.0:1788622940.379964:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:3.0:1788622940.379975:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858310144:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622940.380079:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858310144:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 105us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622940.380089:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:3.0:1788622940.380109:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 88 00000100:00100000:3.0:1788622940.380116:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2350:x1875506858310272:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622940.380141:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2350:x1875506858310272:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622940.380147:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 88 00000100:00080000:3.0:1788622940.380165:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622940.381226:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310016 00000100:00100000:2.0:1788622940.381238:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310016 00000100:00100000:2.0:1788622940.381315:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 230 00000100:00100000:2.0:1788622940.381325:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858310016:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622940.381378:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858310016:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 56us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622940.381386:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 230 00010000:00010000:2.0:1788622941.100038:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622941.231054:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866733312:0@lo:400:kworker.0 00000100:00100000:1.0:1788622941.231158:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622941.231272:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866733440:0@lo:400:kworker.0 00000100:00100000:1.0:1788622941.231305:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622941.231425:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866733184:0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.231464:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622941.231493:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866733696:0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.231517:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622941.231543:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788622941.231550:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866733056:0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.231584:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622941.231603:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866733568:0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.231626:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622941.231657:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733440 00000100:00100000:2.0:1788622941.231668:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733440 00000100:00100000:2.0:1788622941.231734:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733696 00000100:00100000:2.0:1788622941.231737:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733696 00000100:00100000:2.0:1788622941.231798:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788622941.231809:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866733440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.231874:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866733440:12345-0@lo:400:kworker.0 Request processed in 67us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622941.231883:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788622941.231903:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788622941.231909:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866733696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.231959:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866733696:12345-0@lo:400:kworker.0 Request processed in 50us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622941.231965:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788622941.232028:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f6d80 x1875506866733440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622941.232044:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866733440:0@lo:400:kworker.0 00010000:00080000:2.0:1788622941.232081:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f6300 x1875506866733696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622941.232090:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866733696:0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232181:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733312 00000100:00100000:3.0:1788622941.232187:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733312 00000100:00100000:3.0:1788622941.232229:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733184 00000100:00100000:3.0:1788622941.232233:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733184 00000100:00100000:3.0:1788622941.232248:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733568 00000100:00100000:3.0:1788622941.232250:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733568 00000100:00100000:3.0:1788622941.232264:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788622941.232270:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866733312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232321:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866733312:12345-0@lo:400:kworker.0 Request processed in 50us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622941.232327:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788622941.232348:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788622941.232355:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866733184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232390:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866733184:12345-0@lo:400:kworker.0 Request processed in 36us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622941.232396:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788622941.232406:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788622941.232412:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866733568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232436:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866733568:12345-0@lo:400:kworker.0 Request processed in 25us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622941.232441:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788622941.232466:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733056 00000100:00100000:3.0:1788622941.232469:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733056 00000100:00100000:3.0:1788622941.232496:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788622941.232502:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866733056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232532:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866733056:12345-0@lo:400:kworker.0 Request processed in 31us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622941.232538:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:3.0:1788622941.232572:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788622941.232577:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788622941.232580:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788622941.232603:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866733312:0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232625:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866733056:0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232634:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866733568:0@lo:400:kworker.0 00000100:00100000:3.0:1788622941.232642:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866733184:0@lo:400:kworker.0 00000100:00100000:2.0:1788622941.252581:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788622941.252629:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866733824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622941.252731:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622941.253044:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866733824 00000100:00100000:3.0:1788622941.253072:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866733824 00000100:00100000:3.0:1788622941.253146:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788622941.253159:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866733824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788622941.253208:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622941.253281:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866733824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622941.253289:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788622941.253320:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ef52d80 x1875506866733824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622941.253345:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866733824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788622942.124413:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788622943.019466:0:11133:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff51bf7d50 20000000:00000080:2.0:1788622943.019490:0:11133:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997d0544f400 uarg=0000000000000000 20000000:01000000:2.0:1788622943.019532:0:11133:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788622943.019539:0:11133:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788622943.019545:0:11133:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788622943.021945:0:11134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788622943.022140:0:11133:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788622943.043603:0:11133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788622943.043803:0:11133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043829:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043855:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d677d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043861:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d678b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043867:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6799 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043885:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043894:0:11133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043943:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.043972:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 12 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.043990:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866733952:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622943.044104:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6799 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.044114:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6799 expref: 18 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.044123:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734080:0@lo:104: 00000100:00100000:2.0:1788622943.044170:0:11133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788622943.044211:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d678b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.044220:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d678b expref: 18 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.044227:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734208:0@lo:104: 00000100:00100000:0.0:1788622943.044233:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734080 00000100:00100000:0.0:1788622943.044241:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734080 00000100:00100000:2.0:1788622943.044247:0:11133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788622943.044271:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d677d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.044279:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d677d expref: 18 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622943.044280:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734208 00000100:00100000:0.0:1788622943.044283:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734208 00000100:00100000:2.0:1788622943.044287:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734336:0@lo:104: 00000100:00100000:0.0:1788622943.044296:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788622943.044306:0:11133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622943.044306:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11133:x1875506866734080:12345-0@lo:104: 00010000:00010000:0.0:1788622943.044320:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.044321:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.044329:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 12 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.044337:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734464:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622943.044359:0:11133:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f16c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788622943.044371:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788622943.044377:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11133:x1875506866734080:12345-0@lo:104: Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622943.044382:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734080:0@lo:104: 00000100:00100000:0.0:1788622943.044390:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788622943.044409:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734336 00000100:00100000:0.0:1788622943.044413:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734336 00000100:00100000:0.0:1788622943.044429:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788622943.044435:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11133:x1875506866734208:12345-0@lo:104: 00010000:00010000:0.0:1788622943.044443:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622943.044503:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788622943.044508:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11133:x1875506866734208:12345-0@lo:104: Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622943.044513:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788622943.044526:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788622943.044532:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:11133:x1875506866734336:12345-0@lo:104: 00010000:00010000:0.0:1788622943.044541:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.044622:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734208:0@lo:104: 00000100:00100000:2.0:1788622943.044630:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734336:0@lo:104: 00010000:00010000:0.0:1788622943.049941:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788622943.049977:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+3:11133:x1875506866734336:12345-0@lo:104: Request processed in 5436us (5661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622943.049990:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788622943.054874:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788622943.054891:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.054903:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8e00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622943.054908:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.054919:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622943.054926:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622943.054932:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788622943.054998:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055006:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622943.055245:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055478:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e373b8e00/0xef842f43731d6799 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67a0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055496:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788622943.055500:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055506:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8600 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622943.055509:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055516:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622943.055522:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622943.055526:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788622943.055543:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055548:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622943.055564:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055570:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d678b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6792 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055578:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788622943.055586:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055591:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08badc00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622943.055594:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055600:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622943.055605:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622943.055609:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788622943.055622:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055627:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622943.055633:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055639:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d677d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6784 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.055652:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622943.055654:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622943.055656:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622943.056546:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866734592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622943.056639:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622943.056972:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866734720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622943.057097:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622943.057188:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788622943.057194:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866734848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622943.057217:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622943.057373:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734592 00000100:00100000:3.0:1788622943.057382:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734592 00010000:00010000:3.0:1788622943.057422:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6799 expref: 19 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622943.057452:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734720 00000100:00100000:3.0:1788622943.057455:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734720 00010000:00010000:3.0:1788622943.057466:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d678b expref: 20 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622943.057476:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734848 00000100:00100000:3.0:1788622943.057479:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734848 00010000:00010000:3.0:1788622943.057488:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d677d expref: 21 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622943.057501:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788622943.057510:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+21:3279:x1875506866734592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788622943.057523:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622943.057528:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6799 expref: 21 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.057540:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6799 expref: 21 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.057558:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad200/0xef842f43731d67a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6799 expref: 21 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.057586:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622943.057624:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+20:3279:x1875506866734592:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622943.057631:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788622943.058192:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788622943.058201:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866734720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788622943.058210:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622943.058216:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d678b expref: 19 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.058225:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d678b expref: 19 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.058237:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08baca00/0xef842f43731d6792 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d678b expref: 19 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.058247:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622943.058350:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3280:x1875506866734720:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622943.058357:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788622943.058371:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788622943.058377:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3280:x1875506866734848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788622943.058384:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622943.058389:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d677d expref: 17 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.058396:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d677d expref: 17 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.058414:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b9200/0xef842f43731d6784 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d677d expref: 17 pid: 5804 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.058423:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622943.058446:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3280:x1875506866734848:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622943.058452:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788622943.058497:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866734592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622943.058525:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866734848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622943.058533:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866734720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788622943.059694:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622943.059717:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622943.063173:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622943.063231:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622943.063260:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310400 00000100:00100000:2.0:1788622943.063269:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310400 00000100:00100000:0.0:1788622943.063285:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866733952:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622943.063298:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1875506866734464:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622943.063306:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 13 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.063332:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310528 00000100:00100000:2.0:1788622943.063334:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310528 00010000:00010000:0.0:1788622943.063337:0:11133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063345:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 14 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622943.063362:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:2.0:1788622943.063371:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+14:2349:x1875506858310400:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622943.063386:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622943.063393:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 14 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063405:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 14 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063423:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad000/0xef842f43731d67b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6fb expref: 14 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063440:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622943.063498:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858310400:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622943.063505:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:2.0:1788622943.063522:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:2.0:1788622943.063539:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:2351:x1875506858310528:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622943.063564:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622943.063569:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 12 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063578:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 12 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063588:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b8800/0xef842f43731d6776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6c3 expref: 12 pid: 5803 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063599:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063608:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063622:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063630:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063637:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063645:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063650:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788622943.063655:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063672:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063684:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622943.063692:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622943.063711:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:2351:x1875506858310528:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 183us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622943.063717:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 29 00010000:00010000:0.0:1788622943.064015:0:11133:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622943.064023:0:11133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622943.064030:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad400/0xef842f43731d67d1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622943.148257:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622944.089055:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622944.089245:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310656 00000100:00100000:2.0:1788622944.089259:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310656 00000100:00100000:2.0:1788622944.089326:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 232 00000100:00100000:2.0:1788622944.089337:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:5589:x1875506858310656:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622944.089355:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622944.089377:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e725 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.089412:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.089424:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.089434:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788622944.089989:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858310656:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 650us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.090021:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 232 00000100:00100000:0.0:1788622944.096689:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622944.096957:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310784 00000100:00100000:3.0:1788622944.096970:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310784 00000100:00100000:3.0:1788622944.097044:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 233 00000100:00100000:3.0:1788622944.097056:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858310784:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622944.097517:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858310784:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 462us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622944.097528:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 233 00000100:00100000:0.0:1788622944.102628:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622944.104313:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858310912 00000100:00100000:2.0:1788622944.104334:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858310912 00000100:00100000:2.0:1788622944.104431:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 234 00000100:00100000:2.0:1788622944.104446:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858310912:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.104736:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858310912:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 292us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.104783:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 234 00000100:00100000:1.0:1788622944.120959:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622944.121157:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311040 00000100:00100000:2.0:1788622944.121167:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311040 00000100:00100000:2.0:1788622944.121226:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 235 00000100:00100000:2.0:1788622944.121237:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858311040:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622944.121255:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622944.121274:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e72c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.121306:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.121317:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.121326:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad000, rc 0) 00000100:00100000:2.0:1788622944.121377:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858311040:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 142us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.121383:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 235 00000100:00100000:2.0:1788622944.124356:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622944.124590:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311168 00000100:00100000:3.0:1788622944.124601:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311168 00000100:00100000:3.0:1788622944.124677:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 236 00000100:00100000:3.0:1788622944.124688:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858311168:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.135361:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858311168:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 10659us (11003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.135379:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 236 00000100:00100000:2.0:1788622944.154003:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622944.154180:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311296 00000100:00100000:3.0:1788622944.154191:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311296 00000100:00100000:3.0:1788622944.154297:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 237 00000100:00100000:3.0:1788622944.154307:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858311296:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622944.154540:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858311296:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 233us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622944.154548:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 237 10000000:01000000:2.0:1788622944.173872:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788622944.173883:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e3ccbd000 from 7 10000000:01000000:2.0:1788622944.173889:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788622944.173945:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.173958:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.173969:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622944.173998:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866734976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.174069:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622944.174134:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788622944.174259:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866734976 00000100:00100000:3.0:1788622944.174266:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866734976 00000100:00100000:3.0:1788622944.174328:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788622944.174336:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866734976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788622944.174349:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622944.174361:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d67e6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622944.174387:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d67e6 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622944.174398:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d67e6 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622944.174408:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fba00, rc 0) 00000100:00100000:3.0:1788622944.174453:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866734976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622944.174460:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00010000:1.0:1788622944.174575:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622944.175355:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866734976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622944.175376:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.175387:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622944.175457:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.175494:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622944.175542:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788622944.175559:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735104 00000100:00100000:2.0:1788622944.175563:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735104 00000100:00100000:2.0:1788622944.175594:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788622944.175601:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866735104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.175895:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866735104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.175902:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788622944.175946:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.175976:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.176012:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622944.176026:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788622944.176039:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735232 00000100:00100000:2.0:1788622944.176043:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735232 00000100:00100000:2.0:1788622944.176064:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788622944.176069:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866735232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.176215:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866735232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.176221:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788622944.176256:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788622944.184651:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788622944.186258:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788622944.186291:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788622944.186303:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.186316:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622944.186348:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788622944.186350:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e1026d000 from 7 10000000:01000000:2.0:1788622944.186353:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788622944.186391:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.186399:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.186409:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622944.186436:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.186509:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622944.186564:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788622944.187274:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735360 00000100:00100000:0.0:1788622944.187285:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735360 00000100:00100000:0.0:1788622944.187792:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788622944.187804:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866735360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622944.187829:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622944.187845:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d67f4 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.187873:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d67f4 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.187885:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d67f4 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.187894:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9200, rc 0) 00000100:00100000:0.0:1788622944.187963:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866735360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622944.187984:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788622944.188125:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622944.188144:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.188156:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622944.188232:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.188266:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622944.191593:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788622944.191803:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735488 00000100:00100000:1.0:1788622944.191928:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735488 00000100:00100000:3.0:1788622944.192026:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788622944.192041:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866735488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622944.192382:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866735488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622944.192398:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788622944.192501:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.192551:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.192599:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622944.192629:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788622944.192674:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735616 00000100:00100000:3.0:1788622944.192680:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735616 00000100:00100000:3.0:1788622944.192700:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788622944.192706:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866735616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622944.192888:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866735616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622944.192894:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788622944.193047:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788622944.194044:0:11155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788622944.194299:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788622944.194324:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788622944.194337:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.194349:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788622944.194360:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788622944.194363:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e0835b000 from 7 10000000:01000000:0.0:1788622944.194366:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788622944.194408:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.194418:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.194429:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622944.194453:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788622944.194517:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622944.194559:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622944.194609:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735744 00000100:00100000:2.0:1788622944.194617:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735744 00000100:00100000:2.0:1788622944.194663:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788622944.194673:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866735744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622944.194684:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622944.194697:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6802 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.194722:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6802 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.194733:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6802 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.194763:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad400, rc 0) 00000100:00100000:2.0:1788622944.194804:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866735744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.194880:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788622944.199276:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622944.199309:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622944.199324:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622944.199437:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622944.199499:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622944.199578:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622944.199618:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866735872 00000100:00100000:1.0:1788622944.199625:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866735872 00000100:00100000:1.0:1788622944.199709:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788622944.199720:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866735872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622944.200245:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866735872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 525us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622944.200253:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788622944.200326:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866735872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788622944.200363:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866736000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622944.200404:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622944.200563:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622944.200629:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736000 00000100:00100000:2.0:1788622944.200636:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736000 00000100:00100000:2.0:1788622944.200664:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788622944.200672:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866736000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622944.200879:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866736000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622944.200894:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788622944.201013:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866736000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788622944.201965:0:11156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788622944.202211:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788622944.202230:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788622944.202241:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622944.202252:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622944.812297:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788622944.812324:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866736128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622944.812393:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622944.812851:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736128 00000100:00100000:1.0:1788622944.812862:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736128 00000100:00100000:1.0:1788622944.812918:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788622944.812945:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866736128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622944.812982:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622944.813036:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866736128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622944.813058:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788622944.813100:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f4a80 x1875506866736128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622944.813120:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866736128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788622944.813372:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788622945.198729:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622945.499426:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622945.499479:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622945.499606:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311424 00000100:00100000:2.0:1788622945.499617:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311424 00000100:00100000:2.0:1788622945.499686:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 247 00000100:00100000:2.0:1788622945.499696:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2351:x1875506858311424:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622945.499801:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2351:x1875506858311424:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 106us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622945.499809:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 247 00000100:00100000:3.0:1788622945.500109:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311552 00000100:00100000:3.0:1788622945.500115:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311552 00000100:00100000:3.0:1788622945.500159:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 92 00000100:00100000:3.0:1788622945.500168:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858311552:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622945.500202:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858311552:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622945.500208:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 92 00000100:00080000:2.0:1788622945.500261:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622945.503854:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622945.503952:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311680 00000100:00100000:1.0:1788622945.503961:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311680 00000100:00100000:1.0:1788622945.504032:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 93 00000100:00100000:1.0:1788622945.504043:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2351:x1875506858311680:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622945.504112:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2351:x1875506858311680:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622945.504119:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 93 00000100:00080000:3.0:1788622945.504286:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788622946.221981:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622946.348167:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622946.348193:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866736256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622946.348268:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622946.348372:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736256 00000100:00100000:2.0:1788622946.348381:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736256 00000100:00100000:3.0:1788622946.350116:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866736512:0@lo:400:kworker.0 00000100:00100000:3.0:1788622946.350183:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622946.350228:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788622946.350234:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866736384:0@lo:400:kworker.0 00000100:00100000:3.0:1788622946.350265:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622946.350313:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866736896:0@lo:400:kworker.0 00000100:00100000:3.0:1788622946.350340:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622946.350369:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736512 00000100:00100000:3.0:1788622946.350377:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736512 00000100:00100000:3.0:1788622946.350431:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736896 00000100:00100000:3.0:1788622946.350434:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736896 00000100:00100000:1.0:1788622946.350485:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788622946.350498:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866736512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622946.351069:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866736512:12345-0@lo:400:kworker.0 Request processed in 573us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622946.351078:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788622946.351252:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866736512:0@lo:400:kworker.0 00000100:00100000:2.0:1788622946.351558:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736384 00000100:00100000:2.0:1788622946.351564:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736384 00000100:00100000:2.0:1788622946.351612:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788622946.351621:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866736384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622946.351671:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866736384:12345-0@lo:400:kworker.0 Request processed in 52us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622946.351677:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788622946.351970:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866736768:0@lo:400:kworker.0 00000100:00100000:2.0:1788622946.352005:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622946.352099:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788622946.352106:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866736640:0@lo:400:kworker.0 00000100:00100000:1.0:1788622946.352254:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866736384:0@lo:400:kworker.0 00000100:00100000:2.0:1788622946.352313:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622946.352918:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736768 00000100:00100000:2.0:1788622946.352926:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736768 00000100:00100000:1.0:1788622946.356039:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866736640 00000100:00100000:1.0:1788622946.356059:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866736640 00000100:00100000:3.0:1788622946.358959:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788622946.358978:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866736896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622946.359079:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866736896:12345-0@lo:400:kworker.0 Request processed in 107us (8737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622946.359087:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788622946.359122:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788622946.359129:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788622946.359131:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788622946.359162:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788622946.359169:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866736256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788622946.359202:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622946.359238:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866736256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (10971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622946.359244:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788622946.359311:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ef50e00 x1875506866736256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788622946.359331:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866736256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622946.359382:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866736896:0@lo:400:kworker.0 00000100:00100000:2.0:1788622946.360988:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788622946.361004:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866736768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622946.361297:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866736768:12345-0@lo:400:kworker.0 Request processed in 296us (9288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622946.361303:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788622946.361636:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ef50a80 x1875506866736768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622946.361643:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788622946.361651:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866736640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622946.361662:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866736768:0@lo:400:kworker.0 00000100:00100000:1.0:1788622946.361698:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866736640:12345-0@lo:400:kworker.0 Request processed in 47us (9385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622946.361704:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788622946.361710:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866736640:0@lo:400:kworker.0 00000001:02000400:0.0:1788622947.136052:0:11331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788622947.243914:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622948.268075:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622949.293863:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622949.937198:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866737024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622949.937286:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622949.938899:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737024 00000100:00100000:1.0:1788622949.938916:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737024 00000100:00100000:1.0:1788622949.939002:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788622949.939015:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866737024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622949.939060:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622949.939144:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866737024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622949.939152:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788622949.939204:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e065f7b80 x1875506866737024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622949.939230:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866737024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788622949.939480:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788622950.315939:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622950.616536:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622950.616582:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622950.616619:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622950.616712:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311936 00000100:00100000:3.0:1788622950.616725:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311936 00000100:00100000:3.0:1788622950.616833:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858312064 00000100:00100000:3.0:1788622950.616836:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858312064 00000100:00100000:3.0:1788622950.616860:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 97 00000100:00100000:3.0:1788622950.616869:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858311936:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622950.616943:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858311936:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 75us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622950.616950:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 97 00000100:00100000:3.0:1788622950.616967:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 98 00000100:00100000:3.0:1788622950.616979:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858312064:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622950.617005:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858312064:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622950.617013:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 98 00000100:00100000:1.0:1788622950.617019:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858311808 00000100:00100000:1.0:1788622950.617036:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858311808 00000100:00100000:1.0:1788622950.617302:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 249 00000100:00100000:1.0:1788622950.617313:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858311808:12345-192.168.204.19@tcp:400:kworker.0 00000100:00080000:2.0:1788622950.617342:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622950.617352:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858311808:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 41us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622950.617359:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 249 00010000:00010000:2.0:1788622951.345214:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622951.474922:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866737152:0@lo:400:kworker.0 00000100:00100000:1.0:1788622951.475296:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866737536:0@lo:400:kworker.0 00000100:00100000:1.0:1788622951.475399:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622951.475490:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788622951.475497:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866737408:0@lo:400:kworker.0 00000100:00100000:1.0:1788622951.475540:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622951.475560:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866737920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622951.475585:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622951.475633:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737536 00000100:00100000:1.0:1788622951.475643:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737536 00000100:00100000:1.0:1788622951.475726:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788622951.475738:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866737536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622951.475829:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866737536:12345-0@lo:400:kworker.0 Request processed in 94us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.475837:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788622951.475860:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737408 00000100:00100000:1.0:1788622951.475863:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737408 00000100:00100000:1.0:1788622951.475892:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788622951.475899:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866737408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622951.475930:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866737408:12345-0@lo:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.475936:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788622951.475954:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737920 00000100:00100000:1.0:1788622951.475957:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737920 00000100:00100000:1.0:1788622951.475986:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788622951.475992:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866737920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622951.476026:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622951.476059:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866737920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.476066:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788622951.476084:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788622951.476089:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788622951.476098:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622951.476136:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866737408:0@lo:400:kworker.0 00010000:00080000:1.0:1788622951.476151:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a00aa00 x1875506866737920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622951.476165:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866737920:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788622951.476176:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ef52a00 x1875506866737536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622951.476183:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866737536:0@lo:400:kworker.0 00000100:00100000:3.0:1788622951.476615:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622951.476663:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866737664:0@lo:400:kworker.0 00000100:00100000:3.0:1788622951.476691:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622951.476773:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737152 00000100:00100000:1.0:1788622951.476778:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737152 00000100:00100000:1.0:1788622951.476821:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788622951.476829:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866737152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622951.476878:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866737152:12345-0@lo:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.476886:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788622951.477078:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866737152:0@lo:400:kworker.0 00000100:00100000:3.0:1788622951.477092:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788622951.477099:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866737280:0@lo:400:kworker.0 00000100:00100000:3.0:1788622951.477125:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622951.479264:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866737792:0@lo:400:kworker.0 00000100:00100000:3.0:1788622951.479332:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622951.479527:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737664 00000100:00100000:0.0:1788622951.479537:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737664 00000100:00100000:0.0:1788622951.479724:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737280 00000100:00100000:0.0:1788622951.479728:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737280 00000100:00100000:0.0:1788622951.479784:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788622951.479805:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866737664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622951.479902:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866737664:12345-0@lo:400:kworker.0 Request processed in 96us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622951.479925:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788622951.479945:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788622951.479952:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866737280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622951.479984:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866737280:12345-0@lo:400:kworker.0 Request processed in 33us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622951.479991:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788622951.480051:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866737280:0@lo:400:kworker.0 00000100:00100000:0.0:1788622951.480067:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866737664:0@lo:400:kworker.0 00000100:00100000:2.0:1788622951.480471:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866737792 00000100:00100000:2.0:1788622951.480478:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866737792 00000100:00100000:2.0:1788622951.480522:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788622951.480531:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866737792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622951.480696:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866737792:12345-0@lo:400:kworker.0 Request processed in 166us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622951.480704:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788622951.480900:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2ef50700 x1875506866737792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622951.480912:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866737792:0@lo:400:kworker.0 00000100:00080000:1.0:1788622951.484131:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788622951.571706:0:11431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:42:30 (1788622950) === 00000100:00100000:2.0:1788622951.787680:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622951.787863:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622951.789164:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858312320 00000100:00100000:1.0:1788622951.789180:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858312320 00000100:00100000:1.0:1788622951.789268:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:1.0:1788622951.789283:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:9675:x1875506858312320:12345-192.168.204.19@tcp:700:mkdir.0 00000100:00100000:1.0:1788622951.789414:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:9675:x1875506858312320:12345-192.168.204.19@tcp:700:mkdir.0 Request processed in 134us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.789422:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:2.0:1788622951.792214:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622951.804107:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858312192 00000100:00100000:0.0:1788622951.804126:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858312192 00000100:00100000:0.0:1788622951.804160:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858312576 00000100:00100000:0.0:1788622951.804164:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858312576 00000100:00100000:0.0:1788622951.804251:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:0.0:1788622951.804264:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9675:x1875506858312576:12345-192.168.204.19@tcp:36:mkdir.0 00010000:00010000:0.0:1788622951.804351:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622951.804828:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d66f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6ae expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.805331:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097a00) 00010000:00010000:0.0:1788622951.805344:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622951.808610:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:1.0:1788622951.808634:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858312192:12345-192.168.204.19@tcp:41:mkdir.0 00000004:00000024:1.0:1788622951.808695:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788622951.808865:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858312192:12345-192.168.204.19@tcp:41:mkdir.0 Request processed in 234us (21196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.808875:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00010000:00010000:0.0:1788622951.811479:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.811650:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.811664:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.811720:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.811729:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.811737:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622951.816317:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788622951.816344:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.816356:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.816365:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.816372:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622951.816376:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.816385:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.816419:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e05312d00) 00010000:00010000:0.0:1788622951.816423:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622951.816429:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.816436:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6810 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788622951.816620:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013250e47 reply state 000000003d453172 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622951.816634:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788622951.816824:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9675:x1875506858312576:12345-192.168.204.19@tcp:36:mkdir.0 Request processed in 12555us (24616us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788622951.816851:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00010000:00010000:3.0:1788622951.823093:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.823116:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.823125:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.823132:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622951.823137:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.823146:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.823174:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff997e05312e00) 00010000:00010000:3.0:1788622951.823178:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622951.823185:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.823191:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6817 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622951.837568:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622951.837875:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858312704 00000100:00100000:3.0:1788622951.837899:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858312704 00000100:00100000:3.0:1788622951.837967:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:3.0:1788622951.837979:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:9676:x1875506858312704:12345-192.168.204.19@tcp:101:chmod.0 00010000:00010000:3.0:1788622951.838009:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622951.838041:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb000/0xef842f43731d681e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e733 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.838137:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6825 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.838155:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6825 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.838170:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6825 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622951.838304:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788622951.838310:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788622951.838462:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6825 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.838501:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb000/0xef842f43731d681e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e733 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.838521:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6825 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e733 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622951.838531:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788622951.838535:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788622951.838540:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fac00, rc 0) 00000100:00100000:3.0:1788622951.838780:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9676:x1875506858312704:12345-192.168.204.19@tcp:101:chmod.0 Request processed in 801us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622951.838798:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:3.0:1788622951.848077:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622951.848729:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858312960 00000100:00100000:0.0:1788622951.848778:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858312960 00000100:00100000:0.0:1788622951.849065:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788622951.849082:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9676:x1875506858312960:12345-192.168.204.19@tcp:36:chmod.0 00010000:00010000:0.0:1788622951.849159:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622951.849202:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6825 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e733 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.849231:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788622951.849246:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788622951.849811:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.849832:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.849847:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788622951.850392:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9f3d127 reply state 00000000c128e28b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622951.850404:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788622951.850415:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788622951.850554:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:9676:x1875506858312960:12345-192.168.204.19@tcp:36:chmod.0 Request processed in 1474us (2486us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788622951.850563:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 17 00010000:00010000:1.0:1788622951.867693:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.867716:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.867726:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.867782:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622951.867801:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.867812:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.867836:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991c00) 00010000:00010000:1.0:1788622951.867997:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788622951.868006:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.868015:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d682c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622951.886208:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622951.886371:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858313088 00000100:00100000:0.0:1788622951.886386:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858313088 00000100:00100000:0.0:1788622951.886481:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:0.0:1788622951.886494:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9677:x1875506858313088:12345-192.168.204.19@tcp:101:chown.0 00010000:00010000:0.0:1788622951.886529:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622951.886558:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d6833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e73a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.886666:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d683a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.886685:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d683a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.886700:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d683a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622951.886773:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788622951.886778:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788622951.886847:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d683a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.886884:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d6833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e73a expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.886905:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d683a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e73a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622951.886914:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e05312d00) 00010000:00010000:0.0:1788622951.886917:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788622951.886921:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8400, rc 0) 00000100:00100000:0.0:1788622951.887173:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:9677:x1875506858313088:12345-192.168.204.19@tcp:101:chown.0 Request processed in 680us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622951.887191:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:3.0:1788622951.892138:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622951.892246:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858313216 00000100:00100000:1.0:1788622951.892273:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858313216 00000100:00100000:1.0:1788622951.892407:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:1.0:1788622951.892420:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:9677:x1875506858313216:12345-192.168.204.19@tcp:101:chown.0 00010000:00010000:1.0:1788622951.892447:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622951.892474:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d6841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e741 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892567:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892591:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892627:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892645:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892652:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892659:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892844:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892853:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892860:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622951.892899:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788622951.892904:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788622951.892932:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892947:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892955:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892972:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892979:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622951.892985:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.892994:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893009:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e05312d00) 00010000:00010000:1.0:1788622951.893013:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622951.893018:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893026:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893043:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893049:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893054:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893059:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622951.893062:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893079:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893089:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff997e11991c00) 00010000:00010000:1.0:1788622951.893091:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622951.893094:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893101:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d684f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893141:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d6841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e741 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893156:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e741 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622951.893164:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11991400) 00010000:00010000:1.0:1788622951.893167:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788622951.893169:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285600, rc 0) 00000100:00100000:1.0:1788622951.893262:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:9677:x1875506858313216:12345-192.168.204.19@tcp:101:chown.0 Request processed in 843us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622951.893271:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:1.0:1788622951.903404:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622951.903512:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858313472 00000100:00100000:2.0:1788622951.903525:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858313472 00000100:00100000:2.0:1788622951.903603:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:2.0:1788622951.903616:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:9677:x1875506858313472:12345-192.168.204.19@tcp:36:chown.0 00010000:00010000:2.0:1788622951.903690:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622951.903730:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e741 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622951.903772:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11991400) 00010000:00010000:2.0:1788622951.903797:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788622951.903835:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622951.903851:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622951.904211:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788622952.051248:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004d1fbdd reply state 00000000371b52b9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622952.051272:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788622952.051290:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788622952.051423:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:9677:x1875506858313472:12345-192.168.204.19@tcp:36:chown.0 Request processed in 147804us (148027us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788622952.051432:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000001:00080000:2.0:1788622952.051729:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1788622952.051778:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788622952.051808:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788622952.052315:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.052326:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.052334:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.052340:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bace00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622952.052345:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.052352:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.052372:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e07097700) 00010000:00010000:0.0:1788622952.052375:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788622952.052379:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.052384:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d685d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622952.083307:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622952.083409:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858313600 00000100:00100000:3.0:1788622952.083422:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858313600 00000100:00100000:3.0:1788622952.083618:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:3.0:1788622952.083631:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:9678:x1875506858313600:12345-192.168.204.19@tcp:101:touch.500 00010000:00010000:3.0:1788622952.083658:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622952.083680:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb000/0xef842f43731d6864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e748 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788622952.084367:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788622952.091572:0:5810:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7758us 00010000:00010000:3.0:1788622952.107010:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.107040:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.107062:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.107079:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.108175:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.108394:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109029:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109044:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109052:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622952.109078:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788622952.109083:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788622952.109193:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109208:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109214:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109220:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109226:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622952.109230:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109238:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109250:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e05312d00) 00010000:00010000:3.0:1788622952.109260:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622952.109266:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109272:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d686b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109285:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109291:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109297:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109303:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fac00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622952.109306:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109312:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109320:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff997e11ed0100) 00010000:00010000:3.0:1788622952.109323:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622952.109326:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109331:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d6872 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109371:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb000/0xef842f43731d6864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e748 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109397:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e748 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.109404:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788622952.109407:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788622952.109409:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e4100f400, rc 0) 00000100:00100000:3.0:1788622952.109589:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9678:x1875506858313600:12345-192.168.204.19@tcp:101:touch.500 Request processed in 25959us (26355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622952.109607:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788622952.114147:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.114243:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858313856 00000100:00100000:0.0:1788622952.114254:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858313856 00000100:00100000:0.0:1788622952.114365:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:0.0:1788622952.114376:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9678:x1875506858313856:12345-192.168.204.19@tcp:101:touch.500 00010000:00010000:0.0:1788622952.114400:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622952.114424:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d6880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e74f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.114794:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.114811:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.114824:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.114878:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.115040:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.115056:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788622952.116023:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788622952.116294:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d6895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116319:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d6895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116330:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d6895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116372:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116380:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116388:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116394:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622952.116399:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116406:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116419:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:0.0:1788622952.116422:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622952.116426:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116433:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788622952.116445:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e29b7f10 reply state 00000000ac7f28b6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622952.116460:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788622952.116500:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d6880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e74f expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116516:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d6895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e74f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.116524:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e05312300) 00010000:00010000:0.0:1788622952.116526:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788622952.116529:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9000, rc 0) 00000100:00100000:0.0:1788622952.116677:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:9678:x1875506858313856:12345-192.168.204.19@tcp:101:touch.500 Request processed in 2303us (2664us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788622952.116687:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 22 00010000:00010000:3.0:1788622952.119825:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.119847:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.119856:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.119862:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622952.119867:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.119875:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.119894:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff997e05312600) 00010000:00010000:3.0:1788622952.119897:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622952.119902:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.119926:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d688e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622952.126050:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.133267:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858314112 00000100:00100000:0.0:1788622952.133289:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858314112 00000100:00100000:0.0:1788622952.133437:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:0.0:1788622952.133449:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:9678:x1875506858314112:12345-192.168.204.19@tcp:36:touch.500 00010000:00010000:0.0:1788622952.133559:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622952.133588:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d6895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e74f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.133608:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e05312300) 00010000:00010000:0.0:1788622952.133618:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788622952.133663:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.133677:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.133704:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788622952.133900:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068b5d209 reply state 00000000c57ff0f6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622952.133910:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788622952.134023:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:9678:x1875506858314112:12345-192.168.204.19@tcp:36:touch.500 Request processed in 575us (7985us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788622952.134029:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 23 00010000:00010000:3.0:1788622952.139035:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.139067:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.139074:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.139080:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622952.139085:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.139093:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.139111:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e05312b00) 00010000:00010000:3.0:1788622952.139114:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622952.139120:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.139126:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d68a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622952.142686:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.142822:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858314240 00000100:00100000:0.0:1788622952.142832:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858314240 00000100:00100000:0.0:1788622952.142889:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:0.0:1788622952.142900:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:9678:x1875506858314240:12345-192.168.204.19@tcp:101:touch.500 00010000:00010000:0.0:1788622952.142926:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622952.142952:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d68aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e756 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.143033:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d68aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e756 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.143050:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d68aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e756 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.143073:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e05312c00) 00010000:00010000:0.0:1788622952.143076:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788622952.143081:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8200, rc 0) 00000100:00100000:0.0:1788622952.143167:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:9678:x1875506858314240:12345-192.168.204.19@tcp:101:touch.500 Request processed in 268us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622952.143175:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:1.0:1788622952.148368:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622952.148630:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858314368 00000100:00100000:2.0:1788622952.148643:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858314368 00000100:00100000:2.0:1788622952.148733:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:2.0:1788622952.148788:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875506858314368:12345-192.168.204.19@tcp:8:touch.500 00010000:00080000:2.0:1788622952.148826:0:8422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1788622952.148867:0:8422:0:(genops.c:1385:class_connect()) connect: client 3d43f78d-d80c-4ed1-81b4-dc22eca474fb, cookie 0xef842f43731d68b1 00002000:00100000:2.0:1788622952.148895:0:8422:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d43f78d-d80c-4ed1-81b4-dc22eca474fb/ffff997e08479800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788622952.148921:0:8422:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788622952.149196:0:8422:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788622952.149229:0:8422:0:(import.c:65:import_set_state_nolock()) ffff997e0847f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622952.149312:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2347:x1875506858314368:12345-192.168.204.19@tcp:8:touch.500 Request processed in 570us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622952.149321:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:3.0:1788622952.152948:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622952.153136:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858314496 00000100:00100000:2.0:1788622952.153149:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858314496 00000100:00100000:2.0:1788622952.153244:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:2.0:1788622952.153257:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:0:x1875506858314496:12345-192.168.204.19@tcp:2:touch.500 00000100:00080000:3.0:1788622952.153639:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788622952.195262:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788622952.195281:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000100:00100000:3.0:1788622952.195447:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:0:x1875506858314496:12345-192.168.204.19@tcp:2:touch.500 Request processed in 42184us (42505us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788622952.196652:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:3.0:1788622952.198504:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622952.198672:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858314752 00000100:00100000:2.0:1788622952.198683:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858314752 00000100:00100000:2.0:1788622952.198797:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:2.0:1788622952.198809:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:9678:x1875506858314752:12345-192.168.204.19@tcp:35:touch.500 00000100:00100000:2.0:1788622952.199356:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:9678:x1875506858314752:12345-192.168.204.19@tcp:35:touch.500 Request processed in 547us (873us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788622952.199365:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:0.0:1788622952.218906:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622952.219236:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858314880 00000100:00100000:3.0:1788622952.219246:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858314880 00000100:00100000:3.0:1788622952.219315:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:3.0:1788622952.219325:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:9679:x1875506858314880:12345-192.168.204.19@tcp:101:rm.0 00010000:00010000:3.0:1788622952.219351:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622952.219371:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb000/0xef842f43731d68b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e75d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.219444:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d68bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.219462:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d68bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.219475:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d68bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622952.219528:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788622952.219532:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788622952.219595:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d68bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.219624:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb000/0xef842f43731d68b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e75d expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.219647:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d68bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e75d expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.219667:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788622952.219670:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788622952.219674:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fac00, rc 0) 00000100:00100000:3.0:1788622952.220393:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:9679:x1875506858314880:12345-192.168.204.19@tcp:101:rm.0 Request processed in 1064us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622952.220403:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:1.0:1788622952.223509:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.223616:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858315136 00000100:00100000:0.0:1788622952.223629:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858315136 00000100:00100000:0.0:1788622952.223690:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:0.0:1788622952.223700:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:9679:x1875506858315136:12345-192.168.204.19@tcp:101:rm.0 00010000:00010000:0.0:1788622952.223723:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622952.223789:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d68c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e764 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622952.223900:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788622952.224089:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d68c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e764 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.224103:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e05312d00) 00010000:00010000:0.0:1788622952.224107:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788622952.224113:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d68c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e764 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.224127:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8c00, rc 0) 00000100:00100000:0.0:1788622952.224958:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:9679:x1875506858315136:12345-192.168.204.19@tcp:101:rm.0 Request processed in 1252us (1458us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788622952.224968:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:1.0:1788622952.234191:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622952.234284:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858315264 00000100:00100000:2.0:1788622952.234296:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858315264 00000100:00100000:2.0:1788622952.234367:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:2.0:1788622952.234380:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:9679:x1875506858315264:12345-192.168.204.19@tcp:37:rm.0 00000100:00100000:2.0:1788622952.241856:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:9679:x1875506858315264:12345-192.168.204.19@tcp:37:rm.0 Request processed in 7463us (7663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622952.241872:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:0.0:1788622952.251382:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622952.251604:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858315520 00000100:00100000:3.0:1788622952.251613:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858315520 00000100:00100000:0.0:1788622952.251873:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:0.0:1788622952.251884:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e1832b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:9679:x1875506858315520:12345-192.168.204.19@tcp:35:rm.0 00000100:00100000:0.0:1788622952.252350:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e1832b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:9679:x1875506858315520:12345-192.168.204.19@tcp:35:rm.0 Request processed in 467us (981us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788622952.252359:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788622952.256100:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.256458:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858315776 00000100:00100000:0.0:1788622952.256472:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858315776 00000100:00100000:0.0:1788622952.256618:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:0.0:1788622952.256630:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:9679:x1875506858315776:12345-192.168.204.19@tcp:101:rm.0 00010000:00010000:0.0:1788622952.256655:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622952.257200:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d68d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e76b expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.257314:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d68db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.257329:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d68db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.257341:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d68db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622952.257353:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788622952.257621:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d68d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e76b expref: 17 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.257642:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d68db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e76b expref: 16 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.257659:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:0.0:1788622952.257662:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788622952.257666:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9c00, rc 0) 00000100:00100000:0.0:1788622952.258105:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858315776:12345-192.168.204.19@tcp:101:rm.0 Request processed in 1474us (2017us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788622952.258114:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:1.0:1788622952.263863:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.263939:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858315904 00000100:00100000:0.0:1788622952.263951:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858315904 00000100:00100000:0.0:1788622952.264027:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:0.0:1788622952.264039:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858315904:12345-192.168.204.19@tcp:41:rm.0 00000004:00000024:0.0:1788622952.264105:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788622952.264183:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858315904:12345-192.168.204.19@tcp:41:rm.0 Request processed in 145us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622952.264191:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:3.0:1788622952.267228:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622952.267351:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858316032 00000100:00100000:1.0:1788622952.267361:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858316032 00000100:00100000:1.0:1788622952.267429:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:1.0:1788622952.267439:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858316032:12345-192.168.204.19@tcp:101:rm.0 00010000:00010000:1.0:1788622952.267462:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622952.267485:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284000/0xef842f43731d68e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e772 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.267564:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.267580:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.267597:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.267612:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.267618:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.267624:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.269556:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.269583:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.269596:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622952.269652:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788622952.269657:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622952.270027:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270042:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270452:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270463:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270472:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270478:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622952.270483:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270563:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270582:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788622952.270604:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622952.270611:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270619:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284e00/0xef842f43731d68f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270643:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270650:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270657:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270878:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622952.270882:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270889:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270898:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff997e11991a00) 00010000:00010000:2.0:1788622952.270901:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622952.270904:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270910:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284a00/0xef842f43731d68f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270960:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284000/0xef842f43731d68e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e772 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270990:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e772 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.270998:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e05312c00) 00010000:00010000:2.0:1788622952.271000:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622952.271003:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788622952.271336:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:9679:x1875506858316032:12345-192.168.204.19@tcp:101:rm.0 Request processed in 3897us (4120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622952.271430:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:1.0:1788622952.275355:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622952.275667:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858316288 00000100:00100000:0.0:1788622952.275679:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858316288 00000100:00100000:2.0:1788622952.275877:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:2.0:1788622952.275892:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:9679:x1875506858316288:12345-192.168.204.19@tcp:36:rm.0 00010000:00010000:2.0:1788622952.275959:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788622952.275990:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d68fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e772 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276014:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d68aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e756 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276027:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e05312c00) 00010000:00010000:2.0:1788622952.276044:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d68bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e75d expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276054:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788622952.276058:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788622952.276083:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276115:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276127:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276146:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276153:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276160:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276296:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276305:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.276313:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788622952.277415:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788622952.277433:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 276232689342ns, next at 277232686237ns, rc = 0 00010000:00010000:2.0:1788622952.277514:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277529:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277554:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277565:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277572:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277579:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277695:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788622952.277723:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277730:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277737:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277774:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bace00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622952.277789:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277797:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277820:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e07097300) 00010000:00010000:2.0:1788622952.277823:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788622952.277834:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277841:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bace00/0xef842f43731d6913 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277862:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277868:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277874:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277879:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bacc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622952.277881:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277887:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277894:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788622952.277896:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622952.277900:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622952.277905:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bacc00/0xef842f43731d6905 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788622952.277913:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006334125c reply state 00000000e9e4fd24 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622952.277932:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788622952.278049:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858316288:12345-192.168.204.19@tcp:36:rm.0 Request processed in 2157us (2706us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788622952.278058:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 30 00010000:00010000:3.0:1788622952.279320:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788622952.279334:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.279345:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788622952.279349:0:7601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.279358:0:7601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.279373:0:7601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff997e07097300) 00010000:00010000:3.0:1788622952.279377:0:7601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788622952.279381:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.279387:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d691a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.279408:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622952.279424:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622952.279426:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622952.281180:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.281200:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.281208:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.281214:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622952.281219:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.281228:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.281246:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff997e07097900) 00010000:00010000:3.0:1788622952.281249:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622952.281253:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622952.281260:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d690c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622952.283234:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622952.284290:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858316544 00000100:00100000:2.0:1788622952.284306:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858316544 00000100:00100000:2.0:1788622952.284416:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:2.0:1788622952.284428:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:9679:x1875506858316544:12345-192.168.204.19@tcp:35:rm.0 00000100:00100000:2.0:1788622952.285165:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858316544:12345-192.168.204.19@tcp:35:rm.0 Request processed in 734us (1939us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788622952.285175:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788622952.287693:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622952.288548:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858316800 00000100:00100000:1.0:1788622952.288565:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858316800 00000100:00100000:1.0:1788622952.288641:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:1.0:1788622952.288652:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:9679:x1875506858316800:12345-192.168.204.19@tcp:36:rm.0 00010000:00010000:1.0:1788622952.288714:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788622952.288766:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d68db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e76b expref: 16 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288810:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e748 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288826:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788622952.288857:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d683a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e73a expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288868:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e05312d00) 00010000:00010000:1.0:1788622952.288875:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788622952.288904:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288918:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288929:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288961:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288969:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.288976:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.289281:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.289290:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.289297:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622952.289955:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788622952.289978:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.289986:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.289993:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.289999:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622952.290004:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290022:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290036:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff997e11991d00) 00010000:00010000:1.0:1788622952.290039:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788622952.290043:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290049:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d692f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290071:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290077:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290083:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290087:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622952.290090:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290096:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290104:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991c00) 00010000:00010000:1.0:1788622952.290106:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622952.290109:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622952.290124:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6921 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788622952.290138:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b65b597 reply state 0000000036f199ad transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622952.290147:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788622952.290246:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:9679:x1875506858316800:12345-192.168.204.19@tcp:36:rm.0 Request processed in 1593us (2566us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788622952.290254:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 31 00010000:00010000:0.0:1788622952.295954:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.295977:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.295985:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.295992:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622952.295998:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.296146:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.296165:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff997e11991000) 00010000:00010000:0.0:1788622952.296168:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622952.296173:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.296179:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6928 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622952.363956:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622953.390017:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622954.411911:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788622955.052585:0:6689:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 279007839291ns, next at 280007836513ns, rc = 0 00000100:00100000:0.0:1788622955.052612:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622955.052637:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866738048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622955.052805:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622955.052860:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738048 00000100:00100000:1.0:1788622955.052869:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738048 00000100:00100000:1.0:1788622955.052931:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788622955.053027:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866738048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622955.053070:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622955.053117:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866738048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622955.053124:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788622955.053147:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788622955.053478:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f0f7100 x1875506866738048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622955.053504:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866738048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788622955.436223:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622955.744173:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622955.744349:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858316928 00000100:00100000:3.0:1788622955.744360:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858316928 00000100:00100000:3.0:1788622955.744441:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 251 00000100:00100000:3.0:1788622955.744452:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858316928:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622955.744557:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858316928:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 105us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622955.744566:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 251 00000100:00100000:1.0:1788622955.745029:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622955.745064:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622955.745143:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317184 00000100:00100000:3.0:1788622955.745150:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317184 00000100:00100000:3.0:1788622955.745206:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:3.0:1788622955.745213:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858317184:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622955.745268:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858317184:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 55us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622955.745275:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:1.0:1788622955.745449:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00080000:2.0:1788622955.745493:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788622955.752459:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317056 00000100:00100000:0.0:1788622955.752481:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317056 00000100:00080000:3.0:1788622955.752600:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622955.752648:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317312 00000100:00100000:2.0:1788622955.752653:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317312 00000100:00100000:2.0:1788622955.752725:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 102 00000100:00100000:2.0:1788622955.752736:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858317056:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622955.752850:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858317056:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 115us (7783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622955.752858:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 102 00000100:00100000:2.0:1788622955.752875:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 103 00000100:00100000:2.0:1788622955.752882:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858317312:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622955.752906:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858317312:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 25us (7458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622955.752931:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 103 00000100:00080000:3.0:1788622955.753259:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788622956.460345:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622956.588111:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866738304:0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.588180:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622956.588363:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866738176:0@lo:400:kworker.0 00000100:00100000:3.0:1788622956.588409:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622956.588443:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738176 00000100:00100000:3.0:1788622956.588451:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738176 00000100:00100000:3.0:1788622956.588506:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788622956.588515:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866738176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622956.588565:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866738176:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622956.588572:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788622956.588769:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866738816:0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.588804:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622956.588830:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866738560:0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.588854:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622956.588882:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738304 00000100:00100000:2.0:1788622956.588886:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738304 00000100:00100000:2.0:1788622956.588920:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788622956.588999:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866738304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.589042:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866738304:12345-0@lo:400:kworker.0 Request processed in 115us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622956.589049:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788622956.589070:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738816 00000100:00100000:2.0:1788622956.589074:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738816 00000100:00080000:1.0:1788622956.589109:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788622956.589120:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738560 00000100:00100000:2.0:1788622956.589124:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738560 00000100:00100000:2.0:1788622956.589152:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788622956.589159:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866738816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.589187:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866738816:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622956.589193:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788622956.589203:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788622956.589209:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866738560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622956.589375:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866738432:0@lo:400:kworker.0 00000100:00100000:0.0:1788622956.589422:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622956.592654:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866738560:12345-0@lo:400:kworker.0 Request processed in 3439us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622956.592666:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788622956.592729:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738432 00000100:00100000:2.0:1788622956.592737:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738432 00000100:00100000:2.0:1788622956.592817:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788622956.592827:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866738432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.592868:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866738432:12345-0@lo:400:kworker.0 Request processed in 43us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622956.592875:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788622956.593298:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866738176:0@lo:400:kworker.0 00000100:00100000:3.0:1788622956.593311:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866738688:0@lo:400:kworker.0 00000100:00080000:1.0:1788622956.593364:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622956.593374:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622956.593588:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738688 00000100:00100000:1.0:1788622956.593599:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738688 00000100:00100000:1.0:1788622956.593646:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788622956.593653:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866738688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622956.593732:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866738688:12345-0@lo:400:kworker.0 Request processed in 79us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622956.593739:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788622956.594598:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e37398000 x1875506866738816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622956.594616:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866738816:0@lo:400:kworker.0 00000100:00100000:2.0:1788622956.594646:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866738304:0@lo:400:kworker.0 00010000:00080000:1.0:1788622956.595549:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e0612d880 x1875506866738560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622956.595575:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866738560:0@lo:400:kworker.0 00000100:00100000:1.0:1788622956.595599:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622956.595610:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866738944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622956.595673:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622956.595761:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866738944 00000100:00100000:1.0:1788622956.595769:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866738944 00000100:00100000:1.0:1788622956.595815:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788622956.595824:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866738944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622956.595863:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622956.595909:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866738944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622956.595916:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788622956.595951:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a009f80 x1875506866738944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622956.595967:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866738944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622956.597282:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866738432:0@lo:400:kworker.0 00000100:00080000:3.0:1788622956.597636:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622956.597670:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866738688:0@lo:400:kworker.0 00000001:02000400:3.0:1788622956.747093:0:11580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1788622957.185535:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000004:00080000:3.0:1788622957.185564:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788622957.185589:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788622957.185599:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788622957.186141:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866739072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788622957.186224:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622957.187888:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866739072 00000100:00100000:0.0:1788622957.187906:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866739072 00000100:00080000:1.0:1788622957.187999:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788622957.188041:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788622957.188059:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866739072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788622957.188121:0:6655:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788622957.188174:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c3868, atime: 0x6a9c3868, ctime: 0x6a9c3868, blocks: 0x1 00010000:00010000:0.0:1788622957.188184:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.188205:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=281s v=(0 0) 00010000:00010000:0.0:1788622957.188210:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788622957.188218:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.188240:0:6655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.188252:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.188261:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.188289:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788622957.188722:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788622957.188734:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622957.188815:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788622957.188824:0:7601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622957.188837:0:7601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622957.188871:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622957.188879:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d6936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622957.188920:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622957.188923:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622957.188927:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622957.189131:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866739072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1076us (2905us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788622957.189141:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1788622957.190135:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e2ee9dc00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788622957.190149:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866739072:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788622957.485652:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788622957.674482:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:3.0:1788622957.810261:0:11631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4a603cf0 20000000:00000080:3.0:1788622957.810283:0:11631:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997e374be400 uarg=0000000000000000 20000000:01000000:3.0:1788622957.810338:0:11631:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788622957.810347:0:11631:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788622957.810353:0:11631:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788622957.811391:0:11632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788622957.811682:0:11631:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788622957.817772:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788622957.817978:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788622957.818132:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788622957.818156:0:11631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788622957.818185:0:11631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818211:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818222:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818232:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818258:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d67f4 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818266:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6802 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818276:0:11631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818331:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d6802 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818352:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d6802 expref: 18 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622957.818491:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f169f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739200:0@lo:104: 00000100:00100000:3.0:1788622957.818580:0:11631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622957.818662:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866739200 00010000:00010000:3.0:1788622957.818663:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d67f4 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818683:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d67f4 expref: 18 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622957.818683:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866739200 00000100:00100000:3.0:1788622957.818692:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f168700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739328:0@lo:104: 00000100:00100000:3.0:1788622957.818715:0:11631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788622957.818768:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.818776:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622957.818788:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866739328 00000100:00100000:3.0:1788622957.818792:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f169880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739456:0@lo:104: 00000100:00100000:0.0:1788622957.818797:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866739328 00000100:00100000:0.0:1788622957.818817:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788622957.818828:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11631:x1875506866739200:12345-0@lo:104: 00010000:00010000:0.0:1788622957.818843:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622957.819725:0:11631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622957.819817:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788622957.819836:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788622957.819844:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788622957.820082:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788622957.820083:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866739456 00000100:00100000:2.0:1788622957.820090:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866739456 00000100:00100000:0.0:1788622957.820092:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11631:x1875506866739200:12345-0@lo:104: Request processed in 1264us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622957.820100:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788622957.820122:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788622957.820143:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.820157:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 12 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622957.820172:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f168000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739584:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622957.820248:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11631:x1875506866739328:12345-0@lo:104: 00010000:00010000:0.0:1788622957.820263:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.820312:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788622957.820318:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11631:x1875506866739328:12345-0@lo:104: Request processed in 189us (1603us total) trans 0 rc 0/0 00010000:00010000:3.0:1788622957.820385:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.820396:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622957.820406:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f16b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739712:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622957.820516:0:11631:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d06094d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788622957.820547:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f169f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739200:0@lo:104: 00000100:00100000:3.0:1788622957.820558:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f168700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739328:0@lo:104: 00010000:00010000:3.0:1788622957.820804:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788622957.820812:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.820832:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8600 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622957.820838:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.820870:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622957.820879:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622957.820886:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788622957.820937:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.820945:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622957.820974:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.820982:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d6802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d6809 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.821009:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788622957.821013:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.821020:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08badc00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788622957.821023:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.821030:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788622957.821036:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622957.821048:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788622957.821064:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.821070:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788622957.821077:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.821083:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08badc00/0xef842f43731d67f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67fb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.821092:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622957.821094:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622957.821095:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622957.821110:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866739840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622957.821152:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622957.821184:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622957.821190:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f16a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866739968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622957.821212:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622957.821342:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788622957.821359:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11631:x1875506866739456:12345-0@lo:104: 00010000:00010000:2.0:1788622957.821377:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.821429:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788622957.821435:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+4:11631:x1875506866739456:12345-0@lo:104: Request processed in 84us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622957.821453:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788622957.821504:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622957.821510:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.821517:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788622957.821520:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.821527:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788622957.821534:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788622957.821538:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788622957.821699:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622957.821879:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f169880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739456:0@lo:104: 00000100:00100000:1.0:1788622957.822203:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866739840 00000100:00100000:1.0:1788622957.822212:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866739840 00010000:00010000:1.0:1788622957.822248:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6802 expref: 19 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622957.822279:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866739968 00000100:00100000:1.0:1788622957.822283:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866739968 00010000:00010000:1.0:1788622957.822294:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d67f4 expref: 20 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622957.822315:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788622957.822324:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+20:3278:x1875506866739840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788622957.822339:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622957.822345:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d6802 expref: 20 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622957.822358:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d6802 expref: 20 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.822477:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.822485:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788622957.822630:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788622957.822639:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+20:3278:x1875506866739968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788622957.822649:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622957.822654:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d67f4 expref: 20 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622957.822758:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788622957.823187:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.823196:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bad200/0xef842f43731d67e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d67ed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622957.823218:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622957.823220:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622957.823222:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622957.823241:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622957.823290:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866740096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788622957.823329:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad400/0xef842f43731d6809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d6802 expref: 20 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.823332:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d67f4 expref: 20 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622957.823425:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788622957.823690:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788622957.823694:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b9200/0xef842f43731d67fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d67f4 expref: 19 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.823705:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622957.823796:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3278:x1875506866739840:12345-0@lo:103:ldlm_bl.0 Request processed in 1472us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622957.823805:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788622957.823810:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740096 00000100:00100000:0.0:1788622957.823818:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740096 00010000:00010000:0.0:1788622957.823839:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622957.823869:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788622957.823877:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3281:x1875506866740096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788622957.823887:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622957.823897:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.823925:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.823936:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fba00/0xef842f43731d67ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d67e6 expref: 18 pid: 5804 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.823945:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622957.823984:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3281:x1875506866740096:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622957.823990:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788622957.824299:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866740096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788622957.824837:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866739968:12345-0@lo:103:ldlm_bl.0 Request processed in 2198us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622957.824847:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788622957.825228:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f16a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866739968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788622957.825240:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866739840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788622957.827096:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622957.828698:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f168000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739584:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622957.828720:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f16b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875506866739712:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788622957.828793:0:11631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622957.829137:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317440 00000100:00100000:3.0:1788622957.829148:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317440 00010000:00010000:3.0:1788622957.829202:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 13 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622957.829360:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:3.0:1788622957.829482:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858317440:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622957.829505:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622957.829512:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 13 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.829526:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 13 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.829549:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad000/0xef842f43731d67df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e72c expref: 13 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622957.829567:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622957.829694:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:2348:x1875506858317440:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 323us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622957.829703:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:1.0:1788622957.830199:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622957.830632:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317568 00000100:00100000:0.0:1788622957.830642:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317568 00010000:00010000:0.0:1788622957.830693:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622957.830727:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:0.0:1788622957.830738:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:2349:x1875506858317568:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788622957.830776:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622957.830782:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830795:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830825:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac200/0xef842f43731d67d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e725 expref: 12 pid: 5803 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830844:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830854:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830871:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830880:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830888:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830897:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830904:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622957.830909:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830919:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830936:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.830960:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622957.831068:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:2349:x1875506858317568:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 331us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622957.831077:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 34 00010000:00010000:0.0:1788622957.831110:0:11631:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.831119:0:11631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622957.831126:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb000/0xef842f43731d693d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622958.509809:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622959.001365:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622959.001480:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317696 00000100:00100000:1.0:1788622959.001491:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317696 00000100:00100000:1.0:1788622959.001568:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 253 00000100:00100000:1.0:1788622959.001579:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:5589:x1875506858317696:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788622959.001597:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622959.001721:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e07284e00/0xef842f43731d6944 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e779 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.001789:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e07284e00/0xef842f43731d6944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e779 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.001801:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e07284e00/0xef842f43731d6944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e779 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.001810:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284e00, rc 0) 00000100:00100000:1.0:1788622959.001872:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858317696:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 295us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.001880:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 253 00000100:00100000:1.0:1788622959.011489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622959.011590:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317824 00000100:00100000:3.0:1788622959.011608:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317824 00000100:00100000:3.0:1788622959.011676:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 254 00000100:00100000:3.0:1788622959.011686:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858317824:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.013148:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858317824:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 1450us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.013161:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 254 00000100:00100000:2.0:1788622959.025363:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622959.025634:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858317952 00000100:00100000:1.0:1788622959.025654:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858317952 00000100:00100000:1.0:1788622959.025718:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 255 00000100:00100000:1.0:1788622959.025729:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858317952:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788622959.026591:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e088dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858317952:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 859us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.026611:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 255 00000100:00100000:2.0:1788622959.051911:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622959.052067:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318080 00000100:00100000:3.0:1788622959.052077:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318080 00000100:00100000:3.0:1788622959.052140:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 256 00000100:00100000:3.0:1788622959.052151:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:9949:x1875506858318080:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788622959.052427:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:9949:x1875506858318080:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 277us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.052437:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 256 00000100:00100000:2.0:1788622959.067109:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622959.067223:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318208 00000100:00100000:1.0:1788622959.067240:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318208 00000100:00100000:1.0:1788622959.067298:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 257 00000100:00100000:1.0:1788622959.067307:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:9949:x1875506858318208:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788622959.067563:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:9949:x1875506858318208:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 255us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.067571:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 257 00000100:00100000:2.0:1788622959.073388:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622959.074409:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318336 00000100:00100000:3.0:1788622959.074425:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318336 00000100:00100000:3.0:1788622959.074489:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 258 00000100:00100000:3.0:1788622959.074500:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:5589:x1875506858318336:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788622959.074517:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622959.074543:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e013fb400/0xef842f43731d694b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e780 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.074575:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e013fb400/0xef842f43731d694b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e780 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.074587:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e013fb400/0xef842f43731d694b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e780 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.074613:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fb400, rc 0) 00000100:00100000:3.0:1788622959.074809:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858318336:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 296us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.074817:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 258 00000100:00100000:2.0:1788622959.080003:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622959.080737:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318464 00000100:00100000:1.0:1788622959.080773:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318464 00000100:00100000:1.0:1788622959.081071:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 259 00000100:00100000:1.0:1788622959.081083:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858318464:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622959.081419:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858318464:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 337us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.081429:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 259 00000100:00100000:2.0:1788622959.084423:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622959.084666:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318592 00000100:00100000:1.0:1788622959.084677:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318592 00000100:00100000:1.0:1788622959.084732:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 260 00000100:00100000:1.0:1788622959.084772:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858318592:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788622959.085014:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:5589:x1875506858318592:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 272us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.085021:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 260 00000100:00100000:2.0:1788622959.091157:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622959.091342:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318720 00000100:00100000:1.0:1788622959.091360:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318720 00000100:00100000:1.0:1788622959.091425:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 261 00000100:00100000:1.0:1788622959.091435:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:9952:x1875506858318720:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788622959.091707:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:9952:x1875506858318720:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 272us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.091716:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 261 00000100:00100000:2.0:1788622959.099535:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622959.099672:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318848 00000100:00100000:3.0:1788622959.099684:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318848 00000100:00100000:3.0:1788622959.099774:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 262 00000100:00100000:3.0:1788622959.101619:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:9952:x1875506858318848:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788622959.102086:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:9952:x1875506858318848:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 2299us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.103907:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 262 10000000:01000000:2.0:1788622959.467894:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788622959.467905:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e3ccbd000 from 7 10000000:01000000:2.0:1788622959.467912:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788622959.467969:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.467983:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.467995:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622959.468023:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.468096:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622959.468173:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788622959.468352:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740224 00000100:00100000:0.0:1788622959.468361:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740224 00000100:00100000:0.0:1788622959.468481:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788622959.468492:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:5806:x1875506866740224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788622959.468505:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622959.468529:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9400/0xef842f43731d6959 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6952 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622959.468555:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9400/0xef842f43731d6959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6952 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622959.468565:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9400/0xef842f43731d6959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6952 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622959.468574:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9400, rc 0) 00000100:00100000:0.0:1788622959.468634:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866740224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622959.468651:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788622959.468730:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622959.468767:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.468778:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622959.468833:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.468866:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622959.471481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740352 00000100:00100000:1.0:1788622959.471499:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740352 00000100:00100000:2.0:1788622959.472798:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.474056:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788622959.474085:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866740352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.474792:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866740352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 721us (5921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.474802:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788622959.475512:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.475663:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.475739:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622959.475814:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.476057:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740480 00000100:00100000:3.0:1788622959.476064:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740480 00000100:00100000:3.0:1788622959.476108:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788622959.476117:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866740480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.476678:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866740480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 561us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.476686:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788622959.476966:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788622959.477486:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a008a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11646:1875506866740608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622959.477538:0:11646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622959.477710:0:11646:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08689d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622959.477822:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740608 00000100:00100000:1.0:1788622959.477829:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740608 00000100:00100000:1.0:1788622959.477976:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788622959.477987:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:11646:x1875506866740608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622959.478184:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e06558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:11646:x1875506866740608:12345-0@lo:502:llog_process_th.0 Request processed in 198us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.478191:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788622959.478212:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a008a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11646:1875506866740608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788622959.478357:0:11646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788622959.478368:0:11646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622959.478370:0:11646:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788622959.478377:0:11646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff997e3ccbd000 00000020:00000080:0.0:1788622959.478379:0:11646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788622959.478467:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a008a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11646:1875506866740736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622959.478503:0:11646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622959.479819:0:11646:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08689d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.479951:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740736 00000100:00100000:3.0:1788622959.479966:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740736 00000100:00100000:3.0:1788622959.480018:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788622959.480028:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:11646:x1875506866740736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622959.480633:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0655ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:11646:x1875506866740736:12345-0@lo:502:llog_process_th.0 Request processed in 604us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.480660:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788622959.480876:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a008a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11646:1875506866740736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788622959.480913:0:11646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788622959.480920:0:11646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788622959.480922:0:11646:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788622959.480926:0:11646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788622959.481127:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788622959.481147:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788622959.481158:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.481170:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788622959.481180:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788622959.481183:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e1026d000 from 7 10000000:01000000:3.0:1788622959.481186:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788622959.481354:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.481363:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.481372:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622959.481393:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f168a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.481442:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622959.482188:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622959.489431:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740864 00000100:00100000:1.0:1788622959.489450:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740864 00000100:00100000:1.0:1788622959.489621:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788622959.489632:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:5806:x1875506866740864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788622959.489662:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622959.489682:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e07284a00/0xef842f43731d6967 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d6960 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.489724:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e07284a00/0xef842f43731d6967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d6960 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.489736:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e07284a00/0xef842f43731d6967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d6960 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.489772:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284a00, rc 0) 00000100:00100000:1.0:1788622959.489861:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866740864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (8422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.489868:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788622959.489980:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f168a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622959.490001:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.490011:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622959.490083:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.490117:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622959.490900:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.491069:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866740992 00000100:00100000:3.0:1788622959.491082:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866740992 00000100:00100000:3.0:1788622959.491112:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788622959.491119:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866740992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.491522:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866740992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.491530:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788622959.491826:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866740992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788622959.492148:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788622959.492194:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622959.492267:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.492301:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741120 00000100:00100000:3.0:1788622959.492306:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741120 00000100:00100000:3.0:1788622959.492428:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788622959.492436:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866741120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.493269:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866741120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 830us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.493279:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788622959.493441:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788622959.501686:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788622959.508059:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11649:1875506866741248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622959.508157:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622959.508212:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788622959.508707:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741248 00000100:00100000:0.0:1788622959.508716:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741248 00000100:00100000:0.0:1788622959.508801:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788622959.508810:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:11649:x1875506866741248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788622959.509040:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:11649:x1875506866741248:12345-0@lo:502:llog_process_th.0 Request processed in 230us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622959.509057:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788622959.509135:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11649:1875506866741248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788622959.509167:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788622959.509177:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622959.509180:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788622959.509186:0:11649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff997e1026d000 00000020:00000080:2.0:1788622959.509188:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788622959.517216:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11649:1875506866741376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788622959.517332:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622959.517393:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788622959.517988:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741376 00000100:00100000:1.0:1788622959.517997:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741376 00000100:00100000:1.0:1788622959.518053:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788622959.518063:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:11649:x1875506866741376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622959.518323:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:11649:x1875506866741376:12345-0@lo:502:llog_process_th.0 Request processed in 261us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.518331:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788622959.518447:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11649:1875506866741376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788622959.518481:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788622959.518490:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788622959.518492:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788622959.518496:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788622959.519014:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788622959.519036:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788622959.519047:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.519059:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788622959.519069:0:5806:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788622959.519072:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e0835b000 from 7 10000000:01000000:1.0:1788622959.519074:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788622959.519112:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.519120:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622959.519144:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622959.519166:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788622959.519214:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622959.519289:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548780 going to sleep for 11 seconds 00000100:00100000:2.0:1788622959.527728:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741504 00000100:00100000:2.0:1788622959.527769:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741504 00000100:00100000:2.0:1788622959.527836:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788622959.527847:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:5806:x1875506866741504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788622959.527865:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622959.527884:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e08bacc00/0xef842f43731d6975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d696e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.527914:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e08bacc00/0xef842f43731d6975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d696e expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.527944:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e08bacc00/0xef842f43731d6975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d696e expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622959.527955:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bacc00, rc 0) 00000100:00100000:2.0:1788622959.528044:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866741504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (8829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622959.528050:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788622959.528322:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788622959.528343:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.528355:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622959.528433:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f16bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.528471:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622959.528529:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280000 going to sleep for 11 seconds 00000100:00100000:2.0:1788622959.528878:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741632 00000100:00100000:2.0:1788622959.528886:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741632 00000100:00100000:2.0:1788622959.528919:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788622959.528926:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866741632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.529202:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866741632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622959.529210:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788622959.529246:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f16bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.529282:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788622959.529322:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622959.529338:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.530624:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741760 00000100:00100000:3.0:1788622959.530652:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741760 00000100:00100000:3.0:1788622959.530710:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788622959.530722:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866741760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788622959.530989:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:5806:x1875506866741760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.530997:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788622959.531233:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:5806:1875506866741760:0@lo:503:ll_cfg_requeue.0 00010000:00010000:1.0:1788622959.534932:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622959.542540:0:11653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11653:1875506866741888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622959.542645:0:11653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622959.542692:0:11653:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548780 going to sleep for 11 seconds 00000100:00100000:3.0:1788622959.542832:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866741888 00000100:00100000:3.0:1788622959.542840:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866741888 00000100:00100000:3.0:1788622959.542891:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788622959.542901:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:11653:x1875506866741888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788622959.543145:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:11653:x1875506866741888:12345-0@lo:502:llog_process_th.0 Request processed in 244us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622959.543153:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788622959.546676:0:11653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11653:1875506866741888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788622959.546724:0:11653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788622959.546759:0:11653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622959.546762:0:11653:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788622959.546769:0:11653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff997e0835b000 00000020:00000080:1.0:1788622959.546773:0:11653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788622959.546869:0:11653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11653:1875506866742016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622959.546942:0:11653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622959.546983:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742016 00000100:00100000:1.0:1788622959.546990:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742016 00000100:00100000:1.0:1788622959.547041:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788622959.547050:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:11653:x1875506866742016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788622959.547273:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:11653:x1875506866742016:12345-0@lo:502:llog_process_th.0 Request processed in 223us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622959.547282:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788622959.547343:0:11653:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065f16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622959.547356:0:11653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:11653:1875506866742016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788622959.547375:0:11653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788622959.547380:0:11653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788622959.547382:0:11653:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788622959.547386:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788622959.549996:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788622959.550034:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788622959.550046:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622959.550060:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622960.172896:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622960.173665:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866742144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622960.173797:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622960.174157:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742144 00000100:00100000:1.0:1788622960.174167:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742144 00000100:00080000:3.0:1788622960.174256:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622960.174275:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788622960.174288:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866742144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622960.174338:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622960.174398:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866742144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622960.174405:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788622960.174843:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788622960.174849:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e2ee9dc00, transno 4294967300 00000100:00100000:0.0:1788622960.174888:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866742144:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788622960.557124:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788622960.557282:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622960.857438:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622960.857618:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622960.857649:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622960.857684:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622960.858050:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319232 00000100:00100000:3.0:1788622960.858061:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319232 00000100:00100000:3.0:1788622960.858141:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 54 00000100:00100000:3.0:1788622960.858152:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858319232:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622960.858229:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858319232:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 78us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622960.858237:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 54 00000100:00100000:3.0:1788622960.858274:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319104 00000100:00100000:3.0:1788622960.858278:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319104 00000100:00100000:3.0:1788622960.858318:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319360 00000100:00100000:3.0:1788622960.858322:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319360 00000100:00100000:3.0:1788622960.858343:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 107 00000100:00100000:3.0:1788622960.858349:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858319104:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622960.858380:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858319104:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 31us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622960.858397:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 107 00000100:00100000:3.0:1788622960.858409:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 108 00000100:00100000:3.0:1788622960.858415:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858319360:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622960.858441:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858319360:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622960.858447:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 108 00000100:00080000:2.0:1788622960.858895:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788622960.858900:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622960.863201:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858318976 00000100:00100000:1.0:1788622960.863218:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858318976 00000100:00100000:1.0:1788622960.863500:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 278 00000100:00100000:1.0:1788622960.863513:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858318976:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622960.865452:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858318976:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 1927us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622960.865467:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 278 00010000:00010000:3.0:1788622961.582631:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622961.708800:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866742656:0@lo:400:kworker.0 00000100:00100000:1.0:1788622961.708884:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622961.708953:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622961.708959:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866742528:0@lo:400:kworker.0 00000100:00100000:1.0:1788622961.708986:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622961.709129:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866742400:0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.709163:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622961.709191:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866742912:0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.709214:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622961.709239:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788622961.709244:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866742272:0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.709271:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622961.709291:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866742784:0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.709311:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622961.709338:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742656 00000100:00100000:2.0:1788622961.709345:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742656 00000100:00100000:2.0:1788622961.709384:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742912 00000100:00100000:2.0:1788622961.709387:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742912 00000100:00100000:2.0:1788622961.709413:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788622961.709422:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866742656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.709543:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866742656:12345-0@lo:400:kworker.0 Request processed in 121us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622961.709552:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788622961.709568:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788622961.709574:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866742912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.709620:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866742912:12345-0@lo:400:kworker.0 Request processed in 45us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622961.709626:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788622961.710062:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788622961.710098:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f2cdc00 x1875506866742912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622961.710124:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866742912:0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.710154:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742272 00000100:00100000:2.0:1788622961.710158:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742272 00000100:00100000:2.0:1788622961.710196:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788622961.710202:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866742272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622961.710251:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866742272:12345-0@lo:400:kworker.0 Request processed in 49us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622961.710257:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788622961.710289:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866742272:0@lo:400:kworker.0 00000100:00100000:3.0:1788622961.710398:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742528 00000100:00100000:3.0:1788622961.710403:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742528 00000100:00100000:3.0:1788622961.710456:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742400 00000100:00100000:3.0:1788622961.710460:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742400 00000100:00100000:3.0:1788622961.710473:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866742784 00000100:00100000:3.0:1788622961.710475:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866742784 00000100:00100000:3.0:1788622961.710491:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788622961.710497:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866742528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622961.710535:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866742528:12345-0@lo:400:kworker.0 Request processed in 38us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622961.710541:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788622961.710554:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788622961.710568:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866742400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622961.710615:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866742400:12345-0@lo:400:kworker.0 Request processed in 47us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622961.710621:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788622961.710633:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788622961.710639:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866742784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622961.710676:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866742784:12345-0@lo:400:kworker.0 Request processed in 38us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622961.710676:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866743040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622961.710681:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788622961.710708:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622961.710710:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866742784:0@lo:400:kworker.0 00000100:00100000:3.0:1788622961.710722:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866742400:0@lo:400:kworker.0 00000100:00100000:0.0:1788622961.710757:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743040 00000100:00100000:0.0:1788622961.710761:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743040 00000100:00100000:0.0:1788622961.710796:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788622961.710803:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866743040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788622961.710834:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622961.710873:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866743040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622961.710879:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788622961.710904:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a00b480 x1875506866743040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622961.710920:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866743040:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788622961.711258:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622961.711340:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866742528:0@lo:400:kworker.0 00000100:00100000:1.0:1788622961.711352:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866742656:0@lo:400:kworker.0 00010000:00010000:1.0:1788622962.604212:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622963.628368:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622964.652592:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622965.292101:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622965.292130:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866743168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622965.292205:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622965.292325:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743168 00000100:00100000:1.0:1788622965.292334:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743168 00000100:00100000:1.0:1788622965.292407:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788622965.292409:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622965.292418:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866743168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622965.292457:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622965.292513:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866743168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622965.292519:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788622965.292577:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866743168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788622965.676557:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622965.976444:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622965.976494:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622965.976543:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622965.976589:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622965.976640:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319744 00000100:00100000:2.0:1788622965.976652:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319744 00000100:00100000:2.0:1788622965.976724:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:2.0:1788622965.976734:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858319744:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622965.976850:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858319744:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 117us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622965.976858:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:3.0:1788622965.977044:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319616 00000100:00100000:3.0:1788622965.977049:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319616 00000100:00100000:3.0:1788622965.977087:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319872 00000100:00100000:3.0:1788622965.977091:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319872 00000100:00100000:3.0:1788622965.977120:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 112 00000100:00100000:3.0:1788622965.977127:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858319616:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622965.977183:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858319616:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 56us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622965.977191:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 112 00000100:00100000:3.0:1788622965.977203:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 113 00000100:00100000:3.0:1788622965.977210:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858319872:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622965.977248:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858319872:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 38us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622965.977272:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 113 00000100:00080000:0.0:1788622965.977994:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788622965.978003:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622965.979727:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858319488 00000100:00100000:1.0:1788622965.979781:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858319488 00000100:00100000:1.0:1788622965.979858:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 280 00000100:00100000:1.0:1788622965.979869:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858319488:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622965.979956:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858319488:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 89us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622965.979963:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 280 00010000:00010000:2.0:1788622966.700860:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622966.828093:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866743296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622966.828184:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622966.828335:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743296 00000100:00100000:0.0:1788622966.828344:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743296 00000100:00100000:2.0:1788622966.828636:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866743424:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.828691:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622966.828717:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866743936:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.828763:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622966.828785:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788622966.828791:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866743808:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.828818:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622966.828843:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866743680:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.828867:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622966.828884:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622966.828889:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866743552:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.828910:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622966.828937:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743936 00000100:00100000:2.0:1788622966.828942:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743936 00000100:00100000:2.0:1788622966.828975:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743680 00000100:00100000:2.0:1788622966.828978:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743680 00000100:00100000:2.0:1788622966.828992:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743552 00000100:00100000:2.0:1788622966.828994:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743552 00000100:00100000:2.0:1788622966.829009:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788622966.829017:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866743936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829069:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866743936:12345-0@lo:400:kworker.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622966.829077:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788622966.829093:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788622966.829100:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866743680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829133:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866743680:12345-0@lo:400:kworker.0 Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622966.829139:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788622966.829159:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788622966.829165:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866743552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829193:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866743552:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622966.829199:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788622966.829241:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866743552:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829252:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866743680:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829286:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e37398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866743936:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829333:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743808 00000100:00100000:2.0:1788622966.829337:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743808 00000100:00100000:2.0:1788622966.829366:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788622966.829372:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866743808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829410:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866743808:12345-0@lo:400:kworker.0 Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622966.829416:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788622966.829440:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866743808:0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866743424 00000100:00100000:2.0:1788622966.829485:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866743424 00000100:00100000:2.0:1788622966.829520:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788622966.829527:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866743424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622966.829565:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866743424:12345-0@lo:400:kworker.0 Request processed in 39us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622966.829572:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788622966.829606:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866743424:0@lo:400:kworker.0 00000100:00100000:0.0:1788622966.829705:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788622966.829715:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866743296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788622966.829775:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622966.829816:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866743296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622966.829822:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788622966.830099:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788622966.830105:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788622966.830945:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e2300 x1875506866743296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622966.830971:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866743296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788622967.724335:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622968.748327:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622969.772107:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622970.413906:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788622970.413937:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866744064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622970.414045:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622970.421587:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744064 00000100:00100000:1.0:1788622970.421607:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744064 00000100:00100000:1.0:1788622970.421734:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788622970.421811:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866744064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788622970.421902:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622970.422096:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866744064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (8048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622970.422109:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788622970.422295:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622970.423602:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866744064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788622970.797732:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788622970.799900:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788622971.098977:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622971.099038:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622971.099078:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622971.099117:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622971.099154:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320128 00000100:00100000:2.0:1788622971.099169:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320128 00000100:00100000:2.0:1788622971.099248:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320384 00000100:00100000:2.0:1788622971.099252:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320384 00000100:00100000:2.0:1788622971.099280:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:2.0:1788622971.099291:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858320128:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622971.099391:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858320128:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622971.099400:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:2.0:1788622971.099437:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:2.0:1788622971.099444:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858320384:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622971.099469:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858320384:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622971.099476:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00080000:2.0:1788622971.099501:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622971.099808:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320000 00000100:00100000:0.0:1788622971.099813:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320000 00000100:00100000:0.0:1788622971.099855:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 282 00000100:00100000:0.0:1788622971.099863:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858320000:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622971.099895:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858320000:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 34us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622971.099901:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 282 00000100:00100000:3.0:1788622971.100541:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320256 00000100:00100000:3.0:1788622971.100550:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320256 00000100:00100000:3.0:1788622971.100623:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:3.0:1788622971.100633:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858320256:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622971.100674:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858320256:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 45us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622971.100681:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00080000:2.0:1788622971.100997:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788622971.820188:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622971.948105:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788622971.948139:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866744192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622971.948241:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622971.948629:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744192 00000100:00100000:1.0:1788622971.948641:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744192 00000100:00100000:1.0:1788622971.948729:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788622971.948769:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866744192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622971.948826:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622971.948901:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866744192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622971.948908:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788622971.949206:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e3b80 x1875506866744192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622971.949228:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866744192:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788622971.949693:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788622971.950284:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866744320:0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.950360:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622971.950423:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866744832:0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.950455:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622971.950484:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622971.950490:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866744448:0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.950512:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622971.950558:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744832 00000100:00100000:3.0:1788622971.950565:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744832 00000100:00100000:3.0:1788622971.950627:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744448 00000100:00100000:3.0:1788622971.950646:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744448 00000100:00100000:3.0:1788622971.950670:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788622971.950679:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866744832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.950732:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866744832:12345-0@lo:400:kworker.0 Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622971.950739:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788622971.950779:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788622971.950785:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866744448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.950813:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866744448:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622971.950818:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788622971.950844:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866744704:0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.950878:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622971.950901:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788622971.950906:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866744576:0@lo:400:kworker.0 00000100:00080000:0.0:1788622971.951040:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622971.951088:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866744448:0@lo:400:kworker.0 00000100:00100000:0.0:1788622971.951111:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866744832:0@lo:400:kworker.0 00000100:00100000:0.0:1788622971.951169:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744704 00000100:00100000:0.0:1788622971.951173:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744704 00000100:00100000:0.0:1788622971.951205:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788622971.951212:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866744704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622971.951248:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866744704:12345-0@lo:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622971.951254:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788622971.951644:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622971.951681:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866744704:0@lo:400:kworker.0 00000100:00100000:2.0:1788622971.951781:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744320 00000100:00100000:2.0:1788622971.951787:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744320 00000100:00100000:2.0:1788622971.951827:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788622971.951835:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866744320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622971.951883:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e073a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866744320:12345-0@lo:400:kworker.0 Request processed in 49us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622971.951889:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788622971.952072:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744576 00000100:00100000:1.0:1788622971.952077:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744576 00000100:00100000:1.0:1788622971.952134:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788622971.952152:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866744576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622971.952194:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866744576:12345-0@lo:400:kworker.0 Request processed in 53us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622971.952200:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788622971.952223:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622971.952272:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866744320:0@lo:400:kworker.0 00000100:00100000:3.0:1788622971.952405:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866744576:0@lo:400:kworker.0 00010000:00010000:2.0:1788622972.844599:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622973.868229:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622974.892029:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622975.532364:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622975.532401:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866744960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788622975.532474:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622975.532669:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866744960 00000100:00100000:3.0:1788622975.532677:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866744960 00000100:00100000:3.0:1788622975.532784:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788622975.532797:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866744960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788622975.532842:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622975.532898:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866744960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622975.532920:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788622975.532975:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866744960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788622975.533282:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788622975.916198:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622976.223693:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622976.223797:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622976.223899:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320640 00000100:00100000:2.0:1788622976.223910:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320640 00000100:00100000:1.0:1788622976.224020:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320512 00000100:00100000:1.0:1788622976.224025:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320512 00000100:00100000:2.0:1788622976.224045:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 122 00000100:00100000:2.0:1788622976.224059:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858320640:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622976.224086:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 284 00000100:00100000:1.0:1788622976.224096:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858320512:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622976.224141:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858320640:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 86us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622976.224150:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 122 00000100:00100000:1.0:1788622976.226208:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858320512:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 2097us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622976.226224:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 284 00000100:00080000:0.0:1788622976.227463:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622976.238496:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622976.240811:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320768 00000100:00100000:3.0:1788622976.240831:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320768 00000100:00100000:3.0:1788622976.240947:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788622976.240958:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2347:x1875506858320768:12345-192.168.204.19@tcp:9:kworker.0 00000020:00000080:3.0:1788622976.240993:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d68b1 00000100:00080000:3.0:1788622976.241004:0:8422:0:(import.c:65:import_set_state_nolock()) ffff997e0847f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788622976.241063:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788622976.241389:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+2:2347:x1875506858320768:12345-192.168.204.19@tcp:9:kworker.0 Request processed in 432us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622976.241398:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00010000:00010000:1.0:1788622976.242001:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788622976.242533:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622976.249534:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622976.249665:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858320896 00000100:00100000:0.0:1788622976.249675:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858320896 00000100:00100000:0.0:1788622976.249858:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00100000:0.0:1788622976.249869:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858320896:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622976.249948:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858320896:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 81us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622976.249955:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00080000:1.0:1788622976.250433:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788622976.940348:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622977.068219:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866745344:0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.068315:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622977.068383:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788622977.068389:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866745472:0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.068418:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622977.068673:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866745088:0@lo:400:kworker.0 00000100:00100000:2.0:1788622977.068713:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622977.068805:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866745216:0@lo:400:kworker.0 00000100:00100000:3.0:1788622977.068838:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622977.068955:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788622977.068965:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866745856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622977.069002:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622977.072951:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866745600:0@lo:400:kworker.0 00000100:00100000:2.0:1788622977.073045:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622977.073215:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745344 00000100:00100000:2.0:1788622977.073240:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745344 00000100:00100000:1.0:1788622977.073442:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745472 00000100:00100000:1.0:1788622977.073447:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745472 00000100:00100000:1.0:1788622977.073609:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788622977.073619:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866745472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.073693:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866745472:12345-0@lo:400:kworker.0 Request processed in 76us (5274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622977.073701:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788622977.073767:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866745472:0@lo:400:kworker.0 00000100:00100000:3.0:1788622977.073930:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788622977.073964:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622977.074021:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745856 00000100:00100000:3.0:1788622977.074027:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745856 00000100:00080000:1.0:1788622977.074098:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788622977.074103:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788622977.074107:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622977.074116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745216 00000100:00100000:1.0:1788622977.074121:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745216 00000100:00100000:1.0:1788622977.074142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745600 00000100:00100000:1.0:1788622977.074154:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745600 00000100:00100000:1.0:1788622977.074180:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788622977.074187:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866745344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074226:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866745344:12345-0@lo:400:kworker.0 Request processed in 41us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622977.074232:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788622977.074245:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788622977.074251:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866745216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074280:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866745216:12345-0@lo:400:kworker.0 Request processed in 30us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622977.074285:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788622977.074308:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788622977.074323:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866745600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074355:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866745600:12345-0@lo:400:kworker.0 Request processed in 35us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622977.074361:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788622977.074379:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745088 00000100:00100000:1.0:1788622977.074383:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745088 00000100:00100000:1.0:1788622977.074406:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788622977.074413:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866745088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074453:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866745088:12345-0@lo:400:kworker.0 Request processed in 41us (5740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622977.074467:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1788622977.074488:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622977.074511:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866745344:0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074548:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745728 00000100:00100000:1.0:1788622977.074558:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745728 00000100:00100000:1.0:1788622977.074585:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788622977.074591:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866745728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074620:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866745728:12345-0@lo:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622977.074625:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788622977.074666:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866745088:0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074678:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866745600:0@lo:400:kworker.0 00000100:00100000:1.0:1788622977.074710:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866745216:0@lo:400:kworker.0 00010000:00080000:1.0:1788622977.074724:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e084a8e00 x1875506866745728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622977.074734:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788622977.081806:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788622977.081837:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866745856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788622977.081887:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622977.081974:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866745856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (12970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622977.081981:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788622977.084268:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e371e0a80 x1875506866745856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788622977.084712:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866745856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788622977.965571:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788622978.185408:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:3.0:1788622978.185439:0:6680:0:(genops.c:885:class_export_put()) final put ffff997e08479800/3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:1.0:1788622978.185647:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e08479800/3d43f78d-d80c-4ed1-81b4-dc22eca474fb for lustre-OST0000 00000020:00000080:1.0:1788622978.193675:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e0847f000 for lustre-OST0000 00010000:00010000:0.0:1788622978.989874:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788622980.013684:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788622980.014366:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622980.653081:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788622980.653107:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866745984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788622980.653179:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622980.653605:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866745984 00000100:00100000:3.0:1788622980.653615:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866745984 00000100:00100000:3.0:1788622980.653682:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788622980.653694:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866745984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788622980.653732:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622980.653812:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866745984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622980.653818:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788622980.653870:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866745984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788622980.654134:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788622981.041606:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622981.338041:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622981.338292:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622981.338379:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622981.340901:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321024 00000100:00100000:1.0:1788622981.340918:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321024 00000100:00100000:1.0:1788622981.340988:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 286 00000100:00100000:1.0:1788622981.341000:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858321024:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622981.341099:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858321024:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 96us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622981.341118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 286 00000100:00100000:2.0:1788622981.344595:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321280 00000100:00100000:2.0:1788622981.344614:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321280 00000100:00100000:2.0:1788622981.344702:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321152 00000100:00100000:2.0:1788622981.344706:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321152 00000100:00080000:3.0:1788622981.345655:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622981.345779:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 127 00000100:00100000:2.0:1788622981.345794:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858321280:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622981.345888:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858321280:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 100us (7596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622981.345896:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 127 00000100:00100000:2.0:1788622981.345916:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 128 00000100:00100000:2.0:1788622981.345923:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858321152:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622981.345950:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858321152:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 28us (7572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622981.345956:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 128 00010000:00010000:0.0:1788622982.063072:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622982.188186:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866746112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622982.188723:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866746240:0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.188841:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622982.188855:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866746368:0@lo:400:kworker.0 00000100:00100000:0.0:1788622982.188908:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622982.188932:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866746752:0@lo:400:kworker.0 00000100:00100000:0.0:1788622982.188942:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866746880:0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.188969:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622982.188984:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622982.188995:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622982.189004:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866746624:0@lo:400:kworker.0 00000100:00100000:0.0:1788622982.189018:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788622982.189028:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866746496:0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189036:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622982.189070:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622982.189080:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746240 00000100:00100000:2.0:1788622982.189093:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746240 00000100:00100000:0.0:1788622982.189117:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746368 00000100:00100000:0.0:1788622982.189123:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746368 00000100:00100000:2.0:1788622982.189171:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788622982.189172:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746752 00000100:00100000:0.0:1788622982.189178:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746752 00000100:00100000:2.0:1788622982.189186:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866746240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788622982.189231:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746496 00000100:00100000:0.0:1788622982.189236:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746496 00000100:00100000:0.0:1788622982.189262:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788622982.189271:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866746240:12345-0@lo:400:kworker.0 Request processed in 87us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622982.189272:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866746368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189286:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788622982.189324:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788622982.189330:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866746752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189358:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866746752:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622982.189364:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788622982.189378:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788622982.189383:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866746496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189410:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866746496:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622982.189416:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788622982.189422:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622982.189436:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746880 00000100:00100000:2.0:1788622982.189441:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746880 00000100:00100000:2.0:1788622982.189477:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746624 00000100:00100000:2.0:1788622982.189480:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746624 00000100:00100000:1.0:1788622982.189481:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866746112 00000100:00100000:1.0:1788622982.189487:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866746112 00000100:00100000:2.0:1788622982.189504:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788622982.189513:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866746880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189543:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866746880:12345-0@lo:400:kworker.0 Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622982.189547:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788622982.189553:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788622982.189562:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866746112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622982.189569:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788622982.189577:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866746624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189600:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866746624:12345-0@lo:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00002000:00000024:1.0:1788622982.189604:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788622982.189616:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788622982.189658:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866746112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622982.189686:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866746624:0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189701:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866746752:0@lo:400:kworker.0 00000100:00100000:2.0:1788622982.189709:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866746240:0@lo:400:kworker.0 00000100:00080000:2.0:1788622982.189780:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788622982.189785:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788622982.189788:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622982.189812:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866746496:0@lo:400:kworker.0 00010000:00080000:2.0:1788622982.189825:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e3a2d3b80 x1875506866746880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788622998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622982.189836:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866746880:0@lo:400:kworker.0 00000100:00100000:1.0:1788622982.189909:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788622982.189943:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e084a8700 x1875506866746112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788622998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788622982.189960:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866746112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788622982.193974:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866746368:12345-0@lo:400:kworker.0 Request processed in 4695us (5056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622982.193991:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788622982.194574:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866746368:0@lo:400:kworker.0 00000001:02000400:0.0:1788622982.236851:0:11813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:43:01 (1788622981) 00010000:00010000:1.0:1788622983.084056:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622983.825804:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622983.825912:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321408 00000100:00100000:2.0:1788622983.825925:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321408 00000100:00100000:2.0:1788622983.826009:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:2.0:1788622983.826021:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:10221:x1875506858321408:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788622983.826041:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622983.826069:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d697c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e787 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.826142:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.826157:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.826200:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788622983.826227:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788622983.826241:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788622983.826246:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622983.826290:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.826316:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d697c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e787 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.826337:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e787 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.826347:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097200) 00010000:00010000:2.0:1788622983.826350:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788622983.826354:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad600, rc 0) 00000100:00100000:2.0:1788622983.826417:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:10221:x1875506858321408:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 398us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622983.826425:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:3.0:1788622983.835381:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622983.835890:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321536 00000100:00100000:2.0:1788622983.835900:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321536 00000100:00100000:2.0:1788622983.835967:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:2.0:1788622983.835978:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:10222:x1875506858321536:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788622983.836001:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622983.836028:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d698a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e78e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836117:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836131:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836142:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836157:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836175:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836183:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836444:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d699f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836453:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d699f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.836460:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d699f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622983.837419:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788622983.837606:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622983.837641:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d699f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837674:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837681:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837689:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837696:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622983.837717:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837725:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837765:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097200) 00010000:00010000:2.0:1788622983.837768:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622983.837773:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837779:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837796:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837802:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837808:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837820:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622983.837822:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837828:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837837:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff997e07097800) 00010000:00010000:2.0:1788622983.837839:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622983.837842:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837847:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6998 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837896:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d698a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e78e expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837911:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d699f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e78e expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622983.837918:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff997e07097900) 00010000:00010000:2.0:1788622983.837920:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788622983.837923:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08badc00, rc 0) 00000100:00100000:2.0:1788622983.838004:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:10222:x1875506858321536:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 2027us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622983.838012:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:3.0:1788622983.856204:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622983.856774:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321792 00000100:00100000:1.0:1788622983.856785:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321792 00000100:00100000:1.0:1788622983.856857:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:1.0:1788622983.856868:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:10222:x1875506858321792:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788622983.856890:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622983.856911:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d69a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e795 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.856984:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857012:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857025:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857080:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857088:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857095:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857799:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d69bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857812:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.857819:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622983.857830:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788622983.857997:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858005:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858012:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858026:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622983.858031:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858038:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858050:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff997e07097900) 00010000:00010000:1.0:1788622983.858053:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622983.858057:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858063:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d69ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858077:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858084:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858089:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858094:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622983.858096:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858102:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858119:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff997e11991500) 00010000:00010000:1.0:1788622983.858122:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622983.858403:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.858412:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d69b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.860829:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d69a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e795 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.860857:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d69bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e795 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622983.860866:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:1.0:1788622983.860870:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622983.860873:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285e00, rc 0) 00000100:00100000:1.0:1788622983.860961:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10222:x1875506858321792:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 4093us (4769us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788622983.860970:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:1.0:1788622983.873941:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622983.874433:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858321920 00000100:00100000:0.0:1788622983.874444:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858321920 00000100:00100000:0.0:1788622983.874641:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:0.0:1788622983.874652:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10222:x1875506858321920:12345-192.168.204.19@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788622983.874804:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10222:x1875506858321920:12345-192.168.204.19@tcp:59:lhsmtool_posix.0 Request processed in 154us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622983.874828:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 35 00000040:00080000:0.0:1788622984.109422:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788622984.109588:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622985.133652:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622985.775145:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788622985.775171:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866747008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788622985.775249:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622985.775328:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866747008 00000100:00100000:3.0:1788622985.775336:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866747008 00000100:00100000:3.0:1788622985.775395:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788622985.775406:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866747008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788622985.775443:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788622985.775489:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866747008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622985.775508:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788622985.775529:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788622985.775569:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866747008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788622986.156909:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622986.183233:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.187846:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858322048 00000100:00100000:3.0:1788622986.187869:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858322048 00000100:00100000:3.0:1788622986.187953:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:3.0:1788622986.187963:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10264:x1875506858322048:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788622986.187984:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622986.188006:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d69c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e79c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788622986.188201:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788622986.188281:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188297:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188309:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188328:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188335:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188342:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188557:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188572:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188579:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188585:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fac00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622986.188589:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188597:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188610:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097200) 00010000:00010000:3.0:1788622986.188613:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622986.188619:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188625:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d69d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188638:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188643:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188650:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188655:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622986.188665:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188671:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188678:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff997e11ed0e00) 00010000:00010000:3.0:1788622986.188681:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622986.188684:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188689:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188729:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d69c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e79c expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188816:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097200) 00010000:00010000:3.0:1788622986.188819:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622986.188889:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d69c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e79c expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.188903:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fba00, rc 0) 00000100:00100000:3.0:1788622986.189026:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10264:x1875506858322048:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1063us (5805us total) trans 0 rc 301/301 00000100:00100000:3.0:1788622986.189034:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:0.0:1788622986.206055:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.207901:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858322304 00000100:00100000:3.0:1788622986.207918:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858322304 00000100:00100000:3.0:1788622986.207989:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:3.0:1788622986.208000:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10264:x1875506858322304:12345-192.168.204.19@tcp:36:lfs.0 00010000:00010000:3.0:1788622986.208068:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622986.208104:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e787 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.208133:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097200) 00010000:00010000:3.0:1788622986.208145:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788622986.208384:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.208399:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.208411:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.208423:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.208430:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.208436:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622986.209422:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788622986.209436:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.209445:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.209452:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.209464:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622986.209468:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.209476:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.209489:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:3.0:1788622986.209493:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622986.209497:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.209503:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788622986.209522:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000326f6b29 reply state 0000000037e4567c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622986.209532:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788622986.209658:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:10264:x1875506858322304:12345-192.168.204.19@tcp:36:lfs.0 Request processed in 1657us (3613us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788622986.209667:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 37 00010000:00010000:0.0:1788622986.217099:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.217135:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.217144:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.217151:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622986.217157:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.217166:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.217183:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff997e11ed0500) 00010000:00010000:0.0:1788622986.217186:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622986.217192:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.217199:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d69e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622986.384523:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.384670:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858322432 00000100:00100000:3.0:1788622986.384681:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858322432 00000100:00100000:3.0:1788622986.384786:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:3.0:1788622986.384798:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10272:x1875506858322432:12345-192.168.204.19@tcp:101:lctl.0 00010000:00010000:3.0:1788622986.384825:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622986.384852:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7a3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.385028:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d69f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.385044:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.385057:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622986.385096:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788622986.385100:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788622986.385153:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.385395:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d69ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7a3 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.385417:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d69f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7a3 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.385426:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:3.0:1788622986.385429:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788622986.385433:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735a00, rc 0) 00000100:00100000:3.0:1788622986.386143:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:10272:x1875506858322432:12345-192.168.204.19@tcp:101:lctl.0 Request processed in 1342us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622986.386153:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:3.0:1788622986.446690:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.446880:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858322560 00000100:00100000:0.0:1788622986.446890:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858322560 00000100:00100000:0.0:1788622986.446952:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:0.0:1788622986.446962:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:10278:x1875506858322560:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788622986.446982:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622986.447005:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d69fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7aa expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447071:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447087:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447099:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447128:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447136:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447144:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447256:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9600/0xef842f43731d6a0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447265:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9600/0xef842f43731d6a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447293:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9600/0xef842f43731d6a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622986.447323:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788622986.447327:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788622986.447368:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9600/0xef842f43731d6a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447380:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447387:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447393:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447399:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622986.447405:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447413:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447426:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:0.0:1788622986.447430:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622986.447435:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447442:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447468:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447473:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447479:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447484:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622986.447487:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447493:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447501:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff997e05312600) 00010000:00010000:0.0:1788622986.447503:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622986.447506:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447512:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447542:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d69fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7aa expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447555:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9600/0xef842f43731d6a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7aa expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.447573:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622986.447576:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788622986.447578:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9600, rc 0) 00000100:00100000:0.0:1788622986.447658:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:10278:x1875506858322560:12345-192.168.204.19@tcp:101:bash.0 Request processed in 697us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622986.447666:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:2.0:1788622986.458577:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622986.458640:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622986.458680:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.458797:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858322816 00000100:00100000:0.0:1788622986.458807:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858323072 00000100:00100000:1.0:1788622986.458815:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858322944 00000100:00100000:3.0:1788622986.458819:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858322816 00000100:00100000:0.0:1788622986.458819:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858323072 00000100:00100000:1.0:1788622986.458821:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858322944 00000100:00100000:1.0:1788622986.458879:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 288 00000100:00100000:3.0:1788622986.458883:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:1.0:1788622986.458895:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858322944:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622986.458896:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:10278:x1875506858322816:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:3.0:1788622986.458918:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622986.458939:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6a16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7b1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622986.458987:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858322944:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622986.459002:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 288 00000100:00100000:0.0:1788622986.459300:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 132 00000100:00100000:0.0:1788622986.459308:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858323072:12345-192.168.204.19@tcp:400:kworker.0 00000100:00080000:1.0:1788622986.459340:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622986.459344:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858323072:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622986.459350:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 132 00010000:00010000:3.0:1788622986.464318:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.464411:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.464430:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.467417:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.467517:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.467532:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788622986.468595:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788622986.468944:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.468958:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.468981:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469021:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469028:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469035:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469042:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622986.469046:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469054:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469067:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788622986.469069:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622986.469074:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469241:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6a1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788622986.469261:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000174bdac0 reply state 000000008b1617d0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622986.469270:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788622986.469318:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6a16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469335:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.469342:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788622986.469345:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788622986.469348:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734200, rc 0) 00000100:00100000:3.0:1788622986.469567:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10278:x1875506858322816:12345-192.168.204.19@tcp:101:bash.0 Request processed in 10674us (11002us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788622986.469576:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 40 00010000:00010000:0.0:1788622986.472068:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.472088:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.472094:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.472099:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622986.472104:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.472112:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.472154:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11ed0400) 00010000:00010000:0.0:1788622986.472156:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622986.472161:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.472167:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622986.475413:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622986.476406:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858323200 00000100:00100000:2.0:1788622986.476419:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858323200 00000100:00100000:2.0:1788622986.476482:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:2.0:1788622986.476490:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875506858323200:12345-192.168.204.19@tcp:8:bash.0 00010000:00080000:2.0:1788622986.476528:0:6655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1788622986.476565:0:6655:0:(genops.c:1385:class_connect()) connect: client 3d43f78d-d80c-4ed1-81b4-dc22eca474fb, cookie 0xef842f43731d6a39 00002000:00100000:2.0:1788622986.476578:0:6655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d43f78d-d80c-4ed1-81b4-dc22eca474fb/ffff997e07a8b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788622986.476602:0:6655:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788622986.478053:0:6655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788622986.479219:0:6655:0:(import.c:65:import_set_state_nolock()) ffff997e07a8d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788622986.479315:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2347:x1875506858323200:12345-192.168.204.19@tcp:8:bash.0 Request processed in 2820us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622986.479326:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:1.0:1788622986.495832:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622986.495941:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858323328 00000100:00100000:2.0:1788622986.495960:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858323328 00000100:00100000:2.0:1788622986.496077:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:2.0:1788622986.496099:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:0:x1875506858323328:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788622986.496130:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622986.496158:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7b8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788622986.496192:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788622986.496230:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1788622986.496234:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788622986.496246:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.496272:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.496288:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bada00, rc 0) 00000100:00100000:2.0:1788622986.496371:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:0:x1875506858323328:12345-192.168.204.19@tcp:101:bash.0 Request processed in 276us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622986.496378:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00080000:1.0:1788622986.497187:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788622986.504058:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622986.504219:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858323456 00000100:00100000:1.0:1788622986.504238:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858323456 00000100:00100000:1.0:1788622986.504316:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:1.0:1788622986.504327:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:10278:x1875506858323456:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788622986.504347:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622986.504369:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7bf expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.504403:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 8 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.504413:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622986.504418:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622986.504424:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.504610:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 8 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.504626:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 8 pid: 6656 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622986.504783:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8422:1875506866747136:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622986.504895:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a223f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788622986.516657:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.518190:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858323584 00000100:00100000:3.0:1788622986.518206:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858323584 00010000:00010000:3.0:1788622986.518258:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 9 pid: 6656 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622986.518310:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:3.0:1788622986.518320:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858323584:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622986.518336:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622986.518373:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 9 pid: 6656 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.518387:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 9 pid: 6656 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.518436:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788622986.518442:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788622986.518452:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.518464:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.518508:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622986.518524:0:5796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f16ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5796:1875506866747264:192.168.204.19@tcp:105: 00000100:00100000:3.0:1788622986.518627:0:5796:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788622986.519103:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d6a40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b8 expref: 9 pid: 6656 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622986.519133:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8422:1875506866747136:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788622986.519158:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.519169:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284200, rc 0) 00000100:00100000:1.0:1788622986.519214:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:10278:x1875506858323456:12345-192.168.204.19@tcp:101:bash.0 Request processed in 14889us (15167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622986.519222:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:3.0:1788622986.525032:0:5796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f16ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5796:1875506866747264:192.168.204.19@tcp:105: 00010000:00010000:3.0:1788622986.525067:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622986.525160:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858323584:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 6840us (8516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622986.525172:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:1.0:1788622986.525280:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.525797:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858323840 00000100:00100000:3.0:1788622986.525806:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858323840 00000100:00100000:3.0:1788622986.525850:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:3.0:1788622986.525858:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10278:x1875506858323840:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:3.0:1788622986.526315:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10278:x1875506858323840:12345-192.168.204.19@tcp:35:bash.0 Request processed in 456us (1035us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788622986.526343:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788622986.640449:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.642333:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858324096 00000100:00100000:0.0:1788622986.642350:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858324096 00000100:00100000:0.0:1788622986.642427:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:0.0:1788622986.642438:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10288:x1875506858324096:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622986.642467:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622986.642490:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7c6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622986.642591:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788622986.642728:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7c6 expref: 16 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.642780:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:0.0:1788622986.642784:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788622986.642791:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7c6 expref: 16 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.642807:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8800, rc 0) 00000100:00100000:0.0:1788622986.642908:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10288:x1875506858324096:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 471us (2474us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788622986.643222:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:2.0:1788622986.652668:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622986.653055:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858324352 00000100:00100000:3.0:1788622986.653066:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858324352 00000100:00100000:3.0:1788622986.653137:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:3.0:1788622986.653148:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10288:x1875506858324352:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:3.0:1788622986.654989:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:10288:x1875506858324352:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 1830us (2321us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788622986.655003:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:3.0:1788622986.765265:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.765513:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858324480 00000100:00100000:0.0:1788622986.765523:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858324480 00000100:00100000:0.0:1788622986.765582:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:0.0:1788622986.765592:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:10294:x1875506858324480:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622986.765616:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622986.765638:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7cd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.765704:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.765718:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.765730:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622986.765971:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788622986.765975:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788622986.765996:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.766026:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7cd expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.766045:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7cd expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.766076:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622986.766079:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788622986.766083:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9e00, rc 0) 00000100:00100000:0.0:1788622986.766359:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:10294:x1875506858324480:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 766us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622986.766367:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:1.0:1788622986.772502:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.772640:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858324736 00000100:00100000:0.0:1788622986.772650:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858324736 00000100:00100000:0.0:1788622986.772712:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:0.0:1788622986.772723:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:10294:x1875506858324736:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622986.772778:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622986.772799:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7d4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.772930:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6a71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.772947:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.772959:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622986.772971:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788622986.773124:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7d4 expref: 20 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.773165:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7d4 expref: 19 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.773175:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788622986.773178:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788622986.773181:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9800, rc 0) 00000100:00100000:0.0:1788622986.773247:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10294:x1875506858324736:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 526us (761us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788622986.773255:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:2.0:1788622986.781801:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622986.781865:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622986.781950:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858325120 00000100:00100000:1.0:1788622986.781962:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858325120 00000100:00100000:1.0:1788622986.782041:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:1.0:1788622986.782052:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:2348:x1875506858325120:12345-192.168.204.19@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788622986.782060:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858324992 00000100:00100000:0.0:1788622986.782064:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858324992 00010000:00010000:1.0:1788622986.782069:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622986.782095:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7d4 expref: 20 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622986.782100:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:0.0:1788622986.782118:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10294:x1875506858324992:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622986.782137:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622986.782145:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788622986.782151:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7db expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.782163:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622986.782218:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:2348:x1875506858325120:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622986.782226:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00010000:00010000:0.0:1788622986.782257:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6a86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.782271:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.782281:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622986.782293:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788622986.782438:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6a7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7db expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.782452:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7db expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.782459:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788622986.782462:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788622986.782464:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8a00, rc 0) 00000100:00100000:0.0:1788622986.782505:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10294:x1875506858324992:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 398us (717us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788622986.782511:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:2.0:1788622986.795372:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622986.795915:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858325248 00000100:00100000:1.0:1788622986.795936:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858325248 00000100:00100000:1.0:1788622986.795997:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:1.0:1788622986.796008:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858325248:12345-192.168.204.19@tcp:1:lfs.0 00010000:00010000:1.0:1788622986.796055:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.796079:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.796088:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622986.796092:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788622986.796118:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.796157:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.796172:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 7 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622986.796212:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6656:1875506866747392:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622986.796320:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a223f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788622986.804177:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6656:1875506866747392:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622986.804214:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622986.809234:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.809347:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858325376 00000100:00100000:0.0:1788622986.809359:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858325376 00002000:00100000:0.0:1788622986.809408:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff997e3978d500 x1875506858325376/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:62/0 lens 504/0 e 0 to 0 dl 1788622997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788622986.809418:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3978d500 with x1875506858325376 ext(0->12) 00010000:00010000:0.0:1788622986.809427:0:6660:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 8 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.809444:0:6660:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 8 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788622986.809452:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997e3978d500 00000100:00100000:0.0:1788622986.809494:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:0.0:1788622986.809504:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858325376:12345-192.168.204.19@tcp:4:lfs.0 00000001:00100000:0.0:1788622986.907833:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000100:00100000:3.0:1788622986.908573:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858325376:12345-192.168.204.19@tcp:4:lfs.0 Request processed in 99063us (99346us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788622986.908590:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00002000:00100000:3.0:1788622986.908603:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff997e3978d500 x1875506858325376/t4294967299(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:62/0 lens 504/448 e 0 to 0 dl 1788622997 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622986.908614:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3978d500 with x1875506858325376 ext(0->12) 00010000:00010000:3.0:1788622986.908624:0:6660:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622986.908643:0:6660:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788622986.908651:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997e3978d500 00000100:00100000:1.0:1788622986.919853:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.919960:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858325504 00000100:00100000:0.0:1788622986.919971:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858325504 00010000:00010000:0.0:1788622986.920016:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622986.920065:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:0.0:1788622986.920076:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858325504:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788622986.920095:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788622986.920126:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788622986.920130:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788622987 00002000:00010000:0.0:1788622986.920132:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788622987 00002000:00010000:0.0:1788622986.920135:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788622987 00010000:00010000:0.0:1788622986.920142:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.920337:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.920366:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cbf2f37/0xef842f43731d6a47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7bf expref: 9 pid: 8422 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.920387:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788622986.920393:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788622986.920400:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.920412:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.920630:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622986.920697:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858325504:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 622us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622986.920706:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 36 00010000:00010000:2.0:1788622986.923020:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923045:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923127:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923137:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923146:0:6656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923230:0:6656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788622986.923236:0:6656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923246:0:6656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923267:0:6656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622986.923275:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a44196fa/0xef842f43731d6a94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622986.923673:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858325248:12345-192.168.204.19@tcp:1:lfs.0 Request processed in 127662us (128308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622986.923685:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:1.0:1788622986.935694:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622986.936554:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858325760 00000100:00100000:0.0:1788622986.936568:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858325760 00000100:00100000:0.0:1788622986.936691:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:0.0:1788622986.936704:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10294:x1875506858325760:12345-192.168.204.19@tcp:35:lfs.0 00000004:00010000:0.0:1788622986.936833:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7db expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788622986.937417:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788622986.937500:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788622986.939551:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788622986.939653:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.939677:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.939688:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.939791:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.939825:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 24 pid: 5811 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622986.939851:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5812:1875506866747520:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622986.942348:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788622986.949412:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5812:1875506866747520:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788622986.949452:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622986.949526:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622986.949677:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858325888 00000100:00100000:1.0:1788622986.949686:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858325888 00010000:00010000:1.0:1788622986.949727:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 25 pid: 5811 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622986.949784:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:1.0:1788622986.949798:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:2348:x1875506858325888:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622986.949892:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622986.949902:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 25 pid: 5811 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.949915:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 25 pid: 5811 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.950019:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7b1 expref: 25 pid: 5811 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.950062:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788622986.950067:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.950077:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.950084:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.950376:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622986.950474:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:2348:x1875506858325888:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 678us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622986.950482:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 37 00010000:00010000:0.0:1788622986.950531:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.950538:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788622986.950692:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788622986.951192:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788622986.951413:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1cb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866747648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788622986.951521:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622986.951564:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548540 going to sleep for 11 seconds 00000100:00100000:2.0:1788622986.952025:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866747648 00000100:00100000:2.0:1788622986.952034:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866747648 00000100:00100000:2.0:1788622986.952146:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788622986.952165:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866747648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788622986.952252:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866747648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622986.952258:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788622986.952342:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1cb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866747648:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788622986.952408:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788622986.953402:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788622986.953490:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1cb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866747776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788622986.953544:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622986.953579:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622986.953657:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866747776 00000100:00100000:3.0:1788622986.953664:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866747776 00000100:00100000:3.0:1788622986.953709:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788622986.953728:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866747776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788622986.954246:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1875506866747776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 509us (689us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788622986.954254:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788622986.954379:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1cb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866747776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788622986.954446:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788622986.954488:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.954499:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.954517:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.954524:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622986.954529:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.954537:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.954553:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788622986.954557:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788622986.954561:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622986.954568:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6a9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788622986.954791:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788622986.955327:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788622986.955341:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310910598469ns, next at 311910595178ns, rc = 0 00000001:00080000:0.0:1788622986.955350:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788622986.955397:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788622986.955401:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788622986.955409:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6a86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7db expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622986.955592:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10294:x1875506858325760:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 18889us (19911us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788622986.955618:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000020:00080000:0.0:1788622986.955623:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788622986.966874:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622986.967994:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858326016 00000100:00100000:1.0:1788622986.968008:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858326016 00000100:00100000:1.0:1788622986.968089:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:1.0:1788622986.968100:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10294:x1875506858326016:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622986.968143:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622986.968169:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7e2 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.968358:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7e2 expref: 28 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.968376:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7e2 expref: 28 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622986.968414:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788622986.968417:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788622986.968421:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284800, rc 0) 00000100:00100000:1.0:1788622986.968547:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10294:x1875506858326016:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 448us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622986.968554:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:3.0:1788622986.979556:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622986.979658:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858326272 00000100:00100000:2.0:1788622986.979669:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858326272 00000100:00100000:2.0:1788622986.979735:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:2.0:1788622986.979783:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e18328050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10294:x1875506858326272:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:2.0:1788622986.980509:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e18328050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:10294:x1875506858326272:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 762us (964us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788622986.980518:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:3.0:1788622987.130511:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622987.130626:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858326528 00000100:00100000:0.0:1788622987.130637:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858326528 00000100:00100000:0.0:1788622987.130698:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:0.0:1788622987.130709:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:10304:x1875506858326528:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622987.130734:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622987.130795:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7e9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622987.130911:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788622987.131375:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6aa9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7e9 expref: 31 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.131390:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:0.0:1788622987.131393:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788622987.131398:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7e9 expref: 31 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.131412:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8400, rc 0) 00000100:00100000:0.0:1788622987.131484:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10304:x1875506858326528:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 775us (987us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788622987.131491:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:0.0:1788622987.145680:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622987.151972:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858326656 00000100:00100000:3.0:1788622987.151992:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858326656 00000100:00100000:3.0:1788622987.152080:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:3.0:1788622987.152114:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10304:x1875506858326656:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:3.0:1788622987.152217:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152245:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152260:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152279:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152287:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152293:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152642:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152673:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152682:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788622987.152727:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152770:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152778:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152784:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152790:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622987.152794:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152801:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152813:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788622987.152816:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622987.152821:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152827:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152850:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152856:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152862:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152867:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622987.152871:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152877:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152885:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11ed0000) 00010000:00010000:3.0:1788622987.152888:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622987.152891:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152897:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152914:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152920:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152925:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152936:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622987.152939:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152944:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152952:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622987.152954:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622987.152957:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.152963:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622987.153055:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10304:x1875506858326656:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 963us (7385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622987.153064:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:1.0:1788622987.162445:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622987.162534:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858326912 00000100:00100000:0.0:1788622987.162560:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858326912 00000100:00100000:0.0:1788622987.162627:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:0.0:1788622987.162638:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10304:x1875506858326912:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788622987.162951:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10304:x1875506858326912:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 314us (528us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788622987.162960:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00010000:00010000:0.0:1788622987.179915:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622987.226388:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622987.228075:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858327168 00000100:00100000:1.0:1788622987.228096:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858327168 00000100:00100000:1.0:1788622987.228269:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:1.0:1788622987.228282:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10307:x1875506858327168:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622987.228309:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622987.228332:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7f0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228432:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228449:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228462:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228478:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228487:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228512:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228663:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228672:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228679:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622987.228690:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788622987.228853:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228862:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228869:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228874:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622987.228879:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.228887:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.231790:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622987.231803:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622987.231842:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.231854:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.231881:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.231889:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.231895:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.232316:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622987.232320:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.232329:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.232347:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11991500) 00010000:00010000:1.0:1788622987.232349:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622987.232353:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.232358:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.237710:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.237753:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 33 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.237763:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622987.237765:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622987.237769:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285600, rc 0) 00000100:00100000:2.0:1788622987.237841:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10307:x1875506858327168:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 9561us (11466us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788622987.237849:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:1.0:1788622987.247263:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622987.252695:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858327296 00000100:00100000:0.0:1788622987.252716:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858327296 00000100:00100000:0.0:1788622987.252962:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:0.0:1788622987.252977:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10307:x1875506858327296:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:0.0:1788622987.253063:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253083:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253116:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253148:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253156:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253163:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253189:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622987.253195:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253202:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253215:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:0.0:1788622987.253218:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788622987.253224:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.253231:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622987.253328:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10307:x1875506858327296:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 353us (6076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622987.253346:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:1.0:1788622987.257126:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622987.257292:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858327552 00000100:00100000:0.0:1788622987.257302:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858327552 00000100:00100000:0.0:1788622987.258249:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:0.0:1788622987.258265:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10307:x1875506858327552:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788622987.258540:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:10307:x1875506858327552:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 279us (1427us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788622987.258548:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:1.0:1788622987.308237:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622987.308287:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866747904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622987.308364:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622987.308453:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866747904 00000100:00100000:1.0:1788622987.308462:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866747904 00000100:00100000:1.0:1788622987.308516:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788622987.308526:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866747904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788622987.308550:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788622987.308595:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866747904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622987.308618:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788622987.308731:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866747904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788622987.309538:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788622987.309669:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788622987.309696:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866748416:0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.309759:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622987.309835:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866748160:0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.309864:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622987.309884:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788622987.309890:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866748288:0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.309911:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622987.309940:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866748160 00000100:00100000:2.0:1788622987.309946:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866748160 00000100:00100000:2.0:1788622987.309992:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866748288 00000100:00100000:2.0:1788622987.309996:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866748288 00000100:00100000:2.0:1788622987.310027:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788622987.310035:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866748160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.310078:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866748160:12345-0@lo:400:kworker.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622987.310085:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788622987.310112:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788622987.310119:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866748288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.310157:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866748288:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622987.310164:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788622987.310181:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622987.310203:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866748288:0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.310213:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866748160:0@lo:400:kworker.0 00000100:00100000:1.0:1788622987.310500:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866748416 00000100:00100000:1.0:1788622987.310506:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866748416 00000100:00100000:1.0:1788622987.310551:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788622987.310559:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866748416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622987.310602:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866748416:12345-0@lo:400:kworker.0 Request processed in 44us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622987.310608:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788622987.310639:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866748416:0@lo:400:kworker.0 00000100:00080000:2.0:1788622987.310789:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788622987.310948:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866748032:0@lo:400:kworker.0 00000100:00100000:3.0:1788622987.311046:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622987.311138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866748032 00000100:00100000:2.0:1788622987.311227:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866748032 00000100:00100000:2.0:1788622987.312329:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788622987.312347:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866748032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622987.312427:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866748032:12345-0@lo:400:kworker.0 Request processed in 87us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622987.312434:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788622987.312524:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866748032:0@lo:400:kworker.0 00000100:00100000:0.0:1788622987.312702:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866748544:0@lo:400:kworker.0 00000100:00100000:0.0:1788622987.312737:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622987.313191:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866748544 00000100:00100000:3.0:1788622987.313198:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866748544 00000100:00100000:3.0:1788622987.313255:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788622987.313265:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866748544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622987.313309:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866748544:12345-0@lo:400:kworker.0 Request processed in 47us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622987.313324:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788622987.313460:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788622987.313488:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866748544:0@lo:400:kworker.0 00000100:00100000:1.0:1788622987.590301:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622987.590438:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858327808 00000100:00100000:2.0:1788622987.590453:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858327808 00000100:00100000:2.0:1788622987.590537:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:2.0:1788622987.590549:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:10338:x1875506858327808:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:2.0:1788622987.590580:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622987.590613:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6af6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7f7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.590772:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.590790:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.590815:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622987.590830:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788622987.591025:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6af6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f7 expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.591048:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f7 expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.591080:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622987.591084:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622987.591089:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788622987.591183:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:10338:x1875506858327808:12345-192.168.204.19@tcp:101:cat.0 Request processed in 636us (894us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788622987.591191:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:1.0:1788622987.596608:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622987.596663:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622987.596785:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858328192 00000100:00100000:2.0:1788622987.596810:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858328192 00000100:00100000:2.0:1788622987.596887:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:2.0:1788622987.596900:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:10338:x1875506858328192:12345-192.168.204.19@tcp:35:cat.0 00000100:00100000:2.0:1788622987.597257:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:10338:x1875506858328192:12345-192.168.204.19@tcp:35:cat.0 Request processed in 359us (591us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788622987.597266:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:3.0:1788622987.597688:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858327936 00000100:00100000:3.0:1788622987.597696:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858327936 00000100:00100000:3.0:1788622987.597782:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:3.0:1788622987.597792:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:2348:x1875506858327936:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622987.597815:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622987.597850:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f7 expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.597875:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622987.597882:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622987.598241:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:2348:x1875506858327936:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 449us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622987.598249:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:1.0:1788622987.655331:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622987.655647:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858328448 00000100:00100000:3.0:1788622987.655662:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858328448 00000100:00100000:3.0:1788622987.655842:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:3.0:1788622987.655856:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:10344:x1875506858328448:12345-192.168.204.19@tcp:101:dd.0 00010000:00010000:3.0:1788622987.655891:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622987.655896:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788622987.655931:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d6a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7cd expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.655956:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788622987.655963:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788622987.655981:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e7fe expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.656149:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.656166:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.656176:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.656226:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.656241:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 36 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622987.656257:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866748672:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622987.656549:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788622987.661314:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622987.661797:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858328576 00000100:00100000:2.0:1788622987.661948:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858328576 00010000:00010000:2.0:1788622987.662006:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 37 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622987.662113:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:2.0:1788622987.662126:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:2348:x1875506858328576:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622987.662145:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622987.662153:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 37 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.662170:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 37 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.662217:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622987.662223:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.662235:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.662244:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.662269:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622987.662350:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:2348:x1875506858328576:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 226us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622987.662359:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 38 00010000:00010000:3.0:1788622987.663527:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7f0 expref: 36 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622987.663552:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866748672:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622987.663584:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.663596:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.663622:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622987.663651:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788622987.664162:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 37 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.664182:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.664193:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622987.664196:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788622987.664200:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734800, rc 0) 00000100:00100000:3.0:1788622987.664342:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:10344:x1875506858328448:12345-192.168.204.19@tcp:101:dd.0 Request processed in 8486us (9542us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788622987.664351:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:0.0:1788622987.667222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622987.667701:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858328832 00000100:00100000:2.0:1788622987.667715:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858328832 00000100:00100000:2.0:1788622987.668056:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:2.0:1788622987.668070:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:10344:x1875506858328832:12345-192.168.204.19@tcp:36:dd.0 00010000:00010000:2.0:1788622987.668538:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.668565:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.668583:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622987.668675:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788622987.668703:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d607a96 reply state 000000003977c2dd transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622987.668720:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788622987.669151:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:10344:x1875506858328832:12345-192.168.204.19@tcp:36:dd.0 Request processed in 1082us (1936us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788622987.669159:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 52 00000020:00080000:2.0:1788622987.669165:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788622987.677639:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.677663:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.677672:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.677679:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622987.677686:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.677724:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.677797:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622987.677801:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622987.677809:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.677817:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6b20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622987.912612:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:2.0:1788622987.912640:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788622987.912660:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e06548540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788622987.912665:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e09625c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e06548480 00000020:00080000:2.0:1788622987.912669:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e09625600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997e070bf400 00000001:00080000:2.0:1788622987.912722:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000100:00100000:0.0:1788622987.913208:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788622987.913236:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866748800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788622987.913346:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622987.913434:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866748800 00000100:00100000:0.0:1788622987.913444:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866748800 00000100:00100000:0.0:1788622987.913502:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788622987.913513:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866748800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788622987.913547:0:6657:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788622987.913589:0:6657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c388b, atime: 0x6a9c388b, ctime: 0x6a9c388b, blocks: 0x1 00010000:00010000:0.0:1788622987.913599:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.913620:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1788622987.913625:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788622987.913633:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.913653:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.913665:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.913696:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.913716:0:6657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788622987.915538:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875506866748800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2018us (2185us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788622987.915552:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788622987.915591:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622987.915601:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.915616:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622987.915622:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.915634:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.915657:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.915666:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6b27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622987.915688:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622987.915700:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622987.915702:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788622987.915815:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788622987.915928:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788622987.918207:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000004:00080000:2.0:1788622987.918512:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e2f1c9c00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788622987.918524:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866748800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788622987.918599:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858328960 00000100:00100000:3.0:1788622987.918609:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858328960 00000100:00100000:3.0:1788622987.918728:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:3.0:1788622987.918778:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:10358:x1875506858328960:12345-192.168.204.19@tcp:101:stat.0 00010000:00010000:3.0:1788622987.918968:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622987.919000:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e805 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919102:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919121:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919134:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919153:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919186:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919194:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919561:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919575:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919585:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919629:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622987.919648:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 12 pid: 5811 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622987.919664:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866748928:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622987.920153:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622987.923933:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866748928:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622987.923978:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622987.924732:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622987.925195:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858329216 00000100:00100000:3.0:1788622987.925224:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858329216 00000100:00100000:3.0:1788622987.925334:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:3.0:1788622987.925346:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:5587:x1875506858329216:12345-192.168.204.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788622987.926230:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:5587:x1875506858329216:12345-192.168.204.19@tcp:35:ldlm_bl.0 Request processed in 882us (1497us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788622987.926241:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:0.0:1788622987.929220:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622987.929412:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858329344 00000100:00100000:1.0:1788622987.929440:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858329344 00010000:00010000:1.0:1788622987.929492:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 14 pid: 5811 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622987.929585:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:1.0:1788622987.929596:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858329344:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622987.929615:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622987.929623:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 14 pid: 5811 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.929638:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 14 pid: 5811 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.929668:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6b12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7fe expref: 14 pid: 5811 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.929689:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788622987.929695:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.929707:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.929717:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622987.929922:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622987.929990:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2348:x1875506858329344:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 396us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622987.930010:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 39 00010000:00010000:2.0:1788622987.931125:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931142:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622987.931208:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788622987.931213:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622987.931269:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931289:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931301:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931529:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931537:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931544:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622987.931550:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931560:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931579:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622987.931582:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622987.931587:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931594:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6b35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931612:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931619:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931626:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931631:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622987.931641:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931649:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931658:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11ed0000) 00010000:00010000:2.0:1788622987.931661:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622987.931665:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931671:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931732:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e805 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931930:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e805 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622987.931940:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622987.931943:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622987.931947:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734a00, rc 0) 00000100:00100000:2.0:1788622987.932036:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:10358:x1875506858328960:12345-192.168.204.19@tcp:101:stat.0 Request processed in 13296us (13838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622987.932046:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:0.0:1788622988.009141:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.009250:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858329600 00000100:00100000:2.0:1788622988.009264:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858329600 00000100:00100000:2.0:1788622988.009364:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 54 00000100:00100000:2.0:1788622988.009380:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:10364:x1875506858329600:12345-192.168.204.19@tcp:36:truncate.0 00010000:00010000:2.0:1788622988.009482:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622988.009525:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e805 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.009552:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.009559:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788622988.009951:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788622988.010205:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.010223:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.010236:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622988.010296:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788622988.010322:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f158254 reply state 00000000ef415d28 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622988.010333:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788622988.010484:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10364:x1875506858329600:12345-192.168.204.19@tcp:36:truncate.0 Request processed in 1109us (1355us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788622988.010494:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 54 00000020:00080000:2.0:1788622988.010501:0:6676:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788622988.024006:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.024028:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.024037:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.024043:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622988.024049:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.024057:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.024080:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622988.024093:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622988.024100:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.024106:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6b4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622988.163987:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.164198:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858329728 00000100:00100000:2.0:1788622988.164212:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858329728 00000100:00100000:2.0:1788622988.164295:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00100000:2.0:1788622988.164307:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10378:x1875506858329728:12345-192.168.204.19@tcp:101:stat.0 00010000:00010000:2.0:1788622988.164351:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622988.164397:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e80c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164491:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164508:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164524:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164542:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164550:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164557:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164968:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164980:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.164988:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622988.165037:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788622988.165042:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622988.165069:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165104:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165116:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165123:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165131:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165138:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.165144:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165153:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165168:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622988.165172:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.165177:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165185:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6b58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165200:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165207:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165219:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165225:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.165228:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165235:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165243:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097300) 00010000:00010000:2.0:1788622988.165246:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.165250:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165256:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165295:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165311:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.165320:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.165322:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622988.165325:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad600, rc 0) 00000100:00100000:2.0:1788622988.166036:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10378:x1875506858329728:12345-192.168.204.19@tcp:101:stat.0 Request processed in 1726us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622988.166066:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 55 00010000:00010000:1.0:1788622988.207178:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622988.293948:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.295421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858329984 00000100:00100000:3.0:1788622988.295459:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858329984 00000100:00100000:3.0:1788622988.295609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 56 00000100:00100000:3.0:1788622988.295622:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10388:x1875506858329984:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788622988.295653:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622988.295702:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e813 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622988.296158:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788622988.296398:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e813 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.296418:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:3.0:1788622988.296421:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788622988.296428:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e813 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.296448:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734a00, rc 0) 00000100:00100000:3.0:1788622988.296545:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10388:x1875506858329984:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 924us (2607us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788622988.296553:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 56 00000100:00100000:1.0:1788622988.301623:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.302277:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858330240 00000100:00100000:0.0:1788622988.302292:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858330240 00000100:00100000:0.0:1788622988.302505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:0.0:1788622988.302518:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10388:x1875506858330240:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788622988.304447:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:10388:x1875506858330240:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 1920us (2823us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788622988.304463:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:0.0:1788622988.394620:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.395094:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858330496 00000100:00100000:3.0:1788622988.395110:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858330496 00000100:00100000:3.0:1788622988.395206:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:3.0:1788622988.395218:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:10394:x1875506858330496:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:3.0:1788622988.395250:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622988.395280:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e81a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.395443:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.395462:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.395473:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.395522:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.395539:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 17 pid: 5811 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622988.395556:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866749056:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622988.396069:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788622988.399462:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866749056:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622988.399510:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622988.404002:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622988.404182:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858330624 00000100:00100000:1.0:1788622988.404197:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858330624 00010000:00010000:1.0:1788622988.404257:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 18 pid: 5811 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622988.404327:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:1.0:1788622988.404340:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2348:x1875506858330624:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622988.404360:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622988.404369:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 18 pid: 5811 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622988.404393:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 18 pid: 5811 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622988.404427:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6b66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e80c expref: 18 pid: 5811 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622988.404447:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788622988.404454:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622988.404465:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622988.404496:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.404595:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.404604:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622988.404631:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788622988.405070:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788622988.405203:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6b7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.405225:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.405235:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.405237:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788622988.405239:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735600, rc 0) 00000100:00100000:2.0:1788622988.405360:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:10394:x1875506858330496:12345-192.168.204.19@tcp:101:bash.0 Request processed in 10143us (13852us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788622988.405369:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:1.0:1788622988.405411:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:2348:x1875506858330624:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 1073us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622988.405420:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:1.0:1788622988.409184:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.409288:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858330880 00000100:00100000:2.0:1788622988.409303:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858330880 00000100:00100000:2.0:1788622988.409380:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 58 00000100:00100000:2.0:1788622988.409394:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:10394:x1875506858330880:12345-192.168.204.19@tcp:36:bash.0 00010000:00010000:2.0:1788622988.410148:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.410171:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.410185:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622988.410258:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788622988.410290:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6e32486 reply state 00000000ef3ae6c8 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622988.410300:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788622988.410513:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10394:x1875506858330880:12345-192.168.204.19@tcp:36:bash.0 Request processed in 1109us (1330us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788622988.410522:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 58 00000020:00080000:2.0:1788622988.410528:0:6676:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788622988.423193:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.423215:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.423225:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.423232:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622988.423239:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.423269:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.423304:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622988.423309:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622988.423317:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.423325:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6b90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622988.430059:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.430333:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858331008 00000100:00100000:0.0:1788622988.430347:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858331008 00000100:00100000:0.0:1788622988.430425:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:0.0:1788622988.430437:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10394:x1875506858331008:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788622988.430475:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622988.430511:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6b97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e821 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.430622:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.430662:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.430674:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.430738:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.430906:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 20 pid: 5809 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622988.430923:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03285c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866749184:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622988.431108:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065483c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622988.437870:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.439050:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03285c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866749184:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622988.439121:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622988.439247:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858331136 00000100:00100000:3.0:1788622988.439257:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858331136 00010000:00010000:3.0:1788622988.439384:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 21 pid: 5809 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622988.439436:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:3.0:1788622988.439448:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:2348:x1875506858331136:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622988.439469:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622988.439479:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 21 pid: 5809 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.439493:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 21 pid: 5809 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.439523:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6b82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e81a expref: 21 pid: 5809 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.439567:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622988.439573:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.439585:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.439725:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.439913:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788622988.440058:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.440067:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622988.440145:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788622988.440151:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622988.440178:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.440231:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d6b97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e821 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.440251:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e821 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.440266:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.440269:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622988.440272:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8400, rc 0) 00000100:00100000:3.0:1788622988.440330:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:2348:x1875506858331136:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 881us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622988.440338:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:2.0:1788622988.440467:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10394:x1875506858331008:12345-192.168.204.19@tcp:101:bash.0 Request processed in 10032us (10420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622988.440476:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:1.0:1788622988.444159:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.444394:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858331392 00000100:00100000:3.0:1788622988.444409:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858331392 00000100:00100000:3.0:1788622988.444489:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:3.0:1788622988.444501:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e1832ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10394:x1875506858331392:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:3.0:1788622988.445236:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e1832ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10394:x1875506858331392:12345-192.168.204.19@tcp:35:bash.0 Request processed in 734us (1087us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788622988.445247:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:1.0:1788622988.543907:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.544818:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858331648 00000100:00100000:3.0:1788622988.544831:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858331648 00000100:00100000:3.0:1788622988.544918:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:3.0:1788622988.544928:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10405:x1875506858331648:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788622988.544967:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622988.545014:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e828 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622988.545145:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788622988.545509:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ba5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e828 expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.545528:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:3.0:1788622988.545531:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788622988.545537:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6ba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e828 expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.545554:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735600, rc 0) 00000100:00100000:3.0:1788622988.545635:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10405:x1875506858331648:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 708us (1742us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788622988.545642:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:1.0:1788622988.550886:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.551047:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858331776 00000100:00100000:2.0:1788622988.551062:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858331776 00000100:00100000:2.0:1788622988.551154:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:2.0:1788622988.551168:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10405:x1875506858331776:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:2.0:1788622988.551281:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.551307:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.551684:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.551707:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.551738:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.551786:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552195:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552207:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552429:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788622988.552559:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552576:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552584:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552661:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552670:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.552876:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552888:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552917:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622988.552921:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.552929:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552937:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552953:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552960:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552966:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552971:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.552974:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552980:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.552988:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097300) 00010000:00010000:2.0:1788622988.552990:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.552994:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553000:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553029:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553036:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553043:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553048:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.553051:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553057:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553065:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.553068:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.553071:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.553089:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622988.553412:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10405:x1875506858331776:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 2240us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622988.553423:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:1.0:1788622988.559231:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.563334:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858332032 00000100:00100000:0.0:1788622988.563356:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858332032 00000100:00100000:0.0:1788622988.563471:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:0.0:1788622988.563484:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10405:x1875506858332032:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788622988.564595:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:10405:x1875506858332032:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 1108us (5370us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788622988.564607:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:1.0:1788622988.638208:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.638367:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858332288 00000100:00100000:2.0:1788622988.638382:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858332288 00000100:00100000:2.0:1788622988.638461:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 62 00000100:00100000:2.0:1788622988.638492:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:10408:x1875506858332288:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788622988.638526:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622988.638556:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e82f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.638663:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.638682:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.638696:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.638713:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.638721:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.638729:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.640861:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.640885:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.640898:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622988.640929:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788622988.641068:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641089:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641098:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641106:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.641111:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641121:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641137:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622988.641141:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.641146:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641154:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6bcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641170:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641177:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641194:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641200:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622988.641203:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641210:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641219:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097300) 00010000:00010000:2.0:1788622988.641221:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622988.641225:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641232:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641298:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e82f expref: 25 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641462:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e82f expref: 24 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.641472:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.641475:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622988.641478:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad600, rc 0) 00000100:00100000:2.0:1788622988.641597:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10408:x1875506858332288:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 3107us (3398us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788622988.641619:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 62 00000100:00100000:1.0:1788622988.647819:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.648065:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858332416 00000100:00100000:0.0:1788622988.648091:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858332416 00000100:00100000:0.0:1788622988.648175:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:0.0:1788622988.648190:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10408:x1875506858332416:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:0.0:1788622988.648376:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648400:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648415:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648453:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648461:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648469:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648476:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622988.648483:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648493:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648509:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:0.0:1788622988.648512:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788622988.648518:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.648525:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d6beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622988.648640:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10408:x1875506858332416:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 453us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622988.648649:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:1.0:1788622988.652924:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622988.653207:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858332544 00000100:00100000:2.0:1788622988.653232:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858332544 00000100:00100000:2.0:1788622988.653333:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:2.0:1788622988.653346:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:2351:x1875506858332544:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622988.653368:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622988.653405:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e82f expref: 24 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622988.653429:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788622988.653436:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622988.661302:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:2351:x1875506858332544:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 7942us (8374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622988.661330:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788622988.662863:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.663050:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858332800 00000100:00100000:3.0:1788622988.663066:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858332800 00000100:00100000:3.0:1788622988.663211:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:3.0:1788622988.663227:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:10408:x1875506858332800:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:3.0:1788622988.663646:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10408:x1875506858332800:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 421us (791us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788622988.663657:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788622988.882657:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.882920:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858333056 00000100:00100000:3.0:1788622988.882934:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858333056 00000100:00100000:3.0:1788622988.883028:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 64 00000100:00100000:3.0:1788622988.883040:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10426:x1875506858333056:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:3.0:1788622988.883106:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622988.883136:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6bf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e836 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.883303:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6bf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.883324:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.883341:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622988.883355:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788622988.883547:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6bf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e836 expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.883573:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e836 expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.883583:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:3.0:1788622988.883587:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788622988.883591:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734000, rc 0) 00000100:00100000:3.0:1788622988.883681:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10426:x1875506858333056:12345-192.168.204.19@tcp:101:cat.0 Request processed in 641us (1035us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788622988.883689:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 64 00000100:00100000:1.0:1788622988.925368:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.925492:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858333184 00000100:00100000:0.0:1788622988.925506:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858333184 00000100:00100000:0.0:1788622988.925578:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 65 00000100:00100000:0.0:1788622988.925588:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10427:x1875506858333184:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622988.925621:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622988.925651:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e83d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.925777:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.925804:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.925819:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622988.925865:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788622988.925869:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788622988.925890:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.925923:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e83d expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.925980:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e83d expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.925989:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622988.925992:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788622988.925996:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9a00, rc 0) 00000100:00100000:0.0:1788622988.926080:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10427:x1875506858333184:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 482us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622988.926088:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 65 00000100:00100000:1.0:1788622988.937570:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.938489:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858333568 00000100:00100000:0.0:1788622988.938506:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858333568 00000100:00100000:0.0:1788622988.938605:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:0.0:1788622988.938618:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10427:x1875506858333568:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788622988.948364:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10427:x1875506858333568:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 9734us (10795us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788622988.948382:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:1.0:1788622988.971816:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622988.972170:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858333696 00000100:00100000:0.0:1788622988.972185:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858333696 00000100:00100000:0.0:1788622988.972283:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:0.0:1788622988.972418:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10427:x1875506858333696:12345-192.168.204.19@tcp:103:lfs.0 00010000:00010000:0.0:1788622988.972444:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788622988.972481:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6b9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e821 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.972511:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6bf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e836 expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.972528:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7e2 expref: 26 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622988.972564:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991b00) 00010000:00010000:0.0:1788622988.972581:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622988.972720:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:10427:x1875506858333696:12345-192.168.204.19@tcp:103:lfs.0 Request processed in 424us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622988.972731:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:0.0:1788622988.984445:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622988.984540:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858333824 00000100:00100000:3.0:1788622988.984555:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858333824 00000100:00100000:3.0:1788622988.984654:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 66 00000100:00100000:3.0:1788622988.984685:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:10427:x1875506858333824:12345-192.168.204.19@tcp:58:lfs.0 00010000:00010000:3.0:1788622988.985295:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.985318:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622988.985334:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788622988.986664:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788622988.987285:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788622988.987371:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788622988.987586:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:10427:x1875506858333824:12345-192.168.204.19@tcp:58:lfs.0 Request processed in 2897us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622988.987600:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 66 00000100:00100000:1.0:1788622989.041628:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622989.041806:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858333952 00000100:00100000:0.0:1788622989.041821:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858333952 00000100:00100000:0.0:1788622989.041908:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:0.0:1788622989.041921:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:10429:x1875506858333952:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788622989.041966:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622989.041998:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e844 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042118:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042140:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042157:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042175:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042182:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042211:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042524:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042535:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042543:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622989.042593:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788622989.042598:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788622989.042620:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042636:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042646:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042653:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042661:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042668:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.042674:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042694:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042712:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622989.042716:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622989.042722:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042729:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042788:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042795:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042800:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042806:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.042809:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042815:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042822:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e05312e00) 00010000:00010000:0.0:1788622989.042825:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622989.042827:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042843:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042886:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042902:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.042910:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788622989.042913:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788622989.042916:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8e00, rc 0) 00000100:00100000:0.0:1788622989.042999:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10429:x1875506858333952:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1079us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622989.043007:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 67 00010000:00010000:0.0:1788622989.228006:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788622989.229233:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788622989.229241:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788622989.229307:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788622989.229321:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788622989.229508:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03290000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866749312:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788622989.229651:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36e069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622989.233266:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03290000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866749312:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788622989.238107:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.238285:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858334080 00000100:00100000:2.0:1788622989.238299:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858334080 00000100:00100000:2.0:1788622989.238386:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:2.0:1788622989.238399:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334080:12345-192.168.204.19@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788622989.238517:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334080:12345-192.168.204.19@tcp:900:lhsmtool_posix.0 Request processed in 121us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.238526:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:1.0:1788622989.247905:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.248201:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858334208 00000100:00100000:2.0:1788622989.248215:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858334208 00000100:00100000:2.0:1788622989.248293:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:2.0:1788622989.248313:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334208:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788622989.248358:0:6676:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788622989.248527:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334208:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 215us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.248535:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:0.0:1788622989.257495:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.257733:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858334336 00000100:00100000:2.0:1788622989.257764:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858334336 00000100:00100000:2.0:1788622989.257839:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:2.0:1788622989.257850:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334336:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788622989.257945:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.257966:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.257994:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258014:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258022:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258028:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258058:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258093:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258100:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622989.258161:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788622989.258166:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622989.258193:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258208:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258215:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258222:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258229:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622989.258300:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258312:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258326:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:2.0:1788622989.258330:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622989.258336:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258354:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6c38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258370:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258377:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258384:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258390:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622989.258393:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258400:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258408:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff997e07097300) 00010000:00010000:2.0:1788622989.258411:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622989.258413:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258419:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258434:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258441:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258453:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258458:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622989.258461:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258467:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258474:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:2.0:1788622989.258477:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622989.258480:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.258487:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.258582:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334336:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 Request processed in 733us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.258591:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:2.0:1788622989.269573:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.269689:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858334592 00000100:00100000:1.0:1788622989.269703:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858334592 00000100:00100000:1.0:1788622989.269804:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 70 00000100:00100000:1.0:1788622989.269816:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10440:x1875506858334592:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788622989.269845:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622989.269871:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6c4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e84b expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270020:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270040:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270055:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622989.270079:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788622989.270208:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270218:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270225:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270243:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622989.270249:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270259:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270274:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:1.0:1788622989.270278:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788622989.270285:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270292:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270347:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6c4d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e84b expref: 28 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270359:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:1.0:1788622989.270361:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788622989.270365:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6c4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e84b expref: 28 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.270377:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284200, rc 0) 00000100:00100000:1.0:1788622989.270454:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10440:x1875506858334592:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 640us (893us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788622989.270462:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 70 00000100:00100000:1.0:1788622989.275543:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.278981:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858334720 00000100:00100000:3.0:1788622989.278999:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858334720 00000100:00100000:0.0:1788622989.280776:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 71 00000100:00100000:0.0:1788622989.280793:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10440:x1875506858334720:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788622989.280854:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788622989.281027:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10440:x1875506858334720:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 237us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622989.281036:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 71 00000100:00100000:0.0:1788622989.287938:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.288051:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858334976 00000100:00100000:3.0:1788622989.288074:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858334976 00000100:00100000:3.0:1788622989.288157:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:3.0:1788622989.288178:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10440:x1875506858334976:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788622989.288211:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622989.288215:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788622989.288252:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e83d expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.288277:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788622989.288285:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788622989.288314:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e852 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788622989.291390:0:6676:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788622989.292270:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6c69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.292341:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.292359:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.292459:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e852 expref: 29 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.292480:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e852 expref: 28 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.292490:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e11ed0700) 00010000:00010000:3.0:1788622989.292493:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788622989.292498:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734800, rc 0) 00000100:00100000:3.0:1788622989.292679:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10440:x1875506858334976:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 4498us (4747us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788622989.292690:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:2.0:1788622989.301074:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622989.301164:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858335232 00000100:00100000:0.0:1788622989.301178:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858335232 00000100:00100000:0.0:1788622989.301262:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:0.0:1788622989.301275:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10440:x1875506858335232:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788622989.301359:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622989.301401:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6c69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e852 expref: 28 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302031:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e11ed0700) 00010000:00010000:0.0:1788622989.302047:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788622989.302090:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302108:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302122:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302140:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302148:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302155:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302436:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302445:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302461:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302468:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.302474:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302483:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302495:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622989.302498:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622989.302503:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302510:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d6c77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302521:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302527:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302532:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302537:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.302541:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302557:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302565:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf0777728 (ffff997e05312e00) 00010000:00010000:0.0:1788622989.302567:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622989.302570:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.302576:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6c7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf0777728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.302691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10440:x1875506858335232:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1416us (1634us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788622989.302701:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:0.0:1788622989.324920:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.326036:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858335360 00000100:00100000:2.0:1788622989.326053:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858335360 00000100:00100000:2.0:1788622989.326150:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 74 00000100:00100000:2.0:1788622989.326165:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10440:x1875506858335360:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788622989.326195:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622989.326235:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e859 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.326287:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.326306:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.326321:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.326447:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.326471:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.326482:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:2.0:1788622989.326486:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788622989.326491:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788622989.326594:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10440:x1875506858335360:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 432us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.326602:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 74 00000100:00100000:2.0:1788622989.332281:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.332385:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858335616 00000100:00100000:3.0:1788622989.332400:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858335616 00000100:00100000:3.0:1788622989.332519:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 75 00000100:00100000:3.0:1788622989.332533:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:10440:x1875506858335616:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788622989.332671:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.332694:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.332708:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788622989.333137:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788622989.333149:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313288406059ns, next at 314288403451ns, rc = 0 00000004:00010000:3.0:1788622989.333264:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a7e5de9 reply state 000000008a0e054d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622989.333275:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788622989.333405:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10440:x1875506858335616:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 874us (1133us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788622989.333415:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 75 00010000:00010000:1.0:1788622989.335544:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.335565:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.335574:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.335580:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622989.335586:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.335596:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.335621:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:1.0:1788622989.335624:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788622989.335630:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.335636:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6c93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.336165:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.336236:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858335744 00000100:00100000:3.0:1788622989.336290:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858335744 00000100:00100000:3.0:1788622989.336388:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:3.0:1788622989.336400:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:10440:x1875506858335744:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788622989.336434:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622989.336461:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e860 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.336543:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 30 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.336584:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 30 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.336610:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:3.0:1788622989.336614:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788622989.336616:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734200, rc 0) 00000100:00100000:3.0:1788622989.336689:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10440:x1875506858335744:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 291us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622989.336697:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:0.0:1788622989.356647:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.356761:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858335872 00000100:00100000:1.0:1788622989.356776:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858335872 00000100:00100000:1.0:1788622989.356844:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:1.0:1788622989.356854:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875506858335872:12345-192.168.204.19@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788622989.356897:0:6655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1788622989.356959:0:6655:0:(genops.c:1385:class_connect()) connect: client 3d43f78d-d80c-4ed1-81b4-dc22eca474fb, cookie 0xef842f43731d6ca1 00002000:00100000:1.0:1788622989.356974:0:6655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d43f78d-d80c-4ed1-81b4-dc22eca474fb/ffff997e39c9c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788622989.357013:0:6655:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788622989.357299:0:6655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788622989.357340:0:6655:0:(import.c:65:import_set_state_nolock()) ffff997e39c9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788622989.357439:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2347:x1875506858335872:12345-192.168.204.19@tcp:8:lhsmtool_posix.0 Request processed in 584us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622989.357448:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:3.0:1788622989.369455:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.369552:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858336000 00000100:00100000:1.0:1788622989.369566:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858336000 00000100:00100000:1.0:1788622989.369652:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:1.0:1788622989.369665:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:0:x1875506858336000:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788622989.370159:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788622989.435307:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1788622989.435328:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000100:00100000:0.0:1788622989.435689:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:0:x1875506858336000:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 66018us (66237us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788622989.435703:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:1.0:1788622989.446985:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.447162:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858336256 00000100:00100000:3.0:1788622989.447177:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858336256 00000100:00100000:3.0:1788622989.447247:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788622989.447260:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10440:x1875506858336256:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788622989.448015:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10440:x1875506858336256:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 753us (1038us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788622989.448027:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788622989.460277:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.460416:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858336512 00000100:00100000:1.0:1788622989.460429:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858336512 00000100:00100000:1.0:1788622989.460516:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:1.0:1788622989.460530:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10440:x1875506858336512:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788622989.460706:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10440:x1875506858336512:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 178us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622989.460716:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:3.0:1788622989.465562:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.470353:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858336640 00000100:00100000:1.0:1788622989.470374:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858336640 00000100:00100000:1.0:1788622989.470468:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:1.0:1788622989.470480:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10440:x1875506858336640:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788622989.470509:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622989.470541:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ca8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e867 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.470681:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6caf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.470700:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.470714:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622989.470817:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788622989.470843:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.470879:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6ca8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e867 expref: 33 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.470902:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6caf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e867 expref: 32 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.470912:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:1.0:1788622989.470915:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788622989.470920:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285400, rc 0) 00000100:00100000:1.0:1788622989.471004:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10440:x1875506858336640:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 526us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622989.471013:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:1.0:1788622989.477171:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.477260:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858336768 00000100:00100000:2.0:1788622989.477274:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858336768 00000100:00100000:2.0:1788622989.477367:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:2.0:1788622989.477380:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858336768:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788622989.477415:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622989.477450:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e86e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788622989.477483:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c388d, blocks: 0x1 00010000:00010000:2.0:1788622989.477509:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1788622989.477514:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788622989.477527:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 6 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.477554:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 6 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.477571:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788622989.477661:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858336768:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 284us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.477669:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:0.0:1788622989.488184:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.494233:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337024 00000100:00100000:1.0:1788622989.494253:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337024 00000100:00100000:1.0:1788622989.494355:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:1.0:1788622989.494368:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10440:x1875506858337024:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788622989.494530:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10440:x1875506858337024:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 164us (6358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622989.494539:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:0.0:1788622989.501064:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.505251:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337152 00000100:00100000:2.0:1788622989.505270:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337152 00000100:00100000:2.0:1788622989.505374:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:2.0:1788622989.505388:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:10440:x1875506858337152:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788622989.505413:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622989.505441:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e875 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.505482:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 7 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.505508:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788622989.505513:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788622989.505520:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.505908:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 7 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.505929:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 7 pid: 6655 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.505947:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866749440:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622989.506154:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622989.513632:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.514169:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337280 00000100:00100000:3.0:1788622989.514184:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337280 00010000:00010000:3.0:1788622989.514241:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 8 pid: 6655 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622989.514317:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:3.0:1788622989.514329:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858337280:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622989.514347:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622989.514379:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 8 pid: 6655 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.514395:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 8 pid: 6655 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.514437:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788622989.514443:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788622989.514454:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.514466:0:7602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.514518:0:7602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622989.514535:0:7602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7602:1875506866749568:192.168.204.19@tcp:105: 00000100:00100000:3.0:1788622989.515179:0:7602:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788622989.518722:0:7602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7602:1875506866749568:192.168.204.19@tcp:105: 00010000:00010000:3.0:1788622989.518806:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622989.518883:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858337280:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 4553us (5260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622989.518897:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 42 00010000:00010000:2.0:1788622989.521468:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafcfcbd/0xef842f43731d6cb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e86e expref: 7 pid: 6655 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.521501:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866749440:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622989.521543:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.521562:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:0.0:1788622989.525593:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:10440:x1875506858337152:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 20180us (24525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622989.525609:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:2.0:1788622989.531570:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.532027:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337408 00000100:00100000:3.0:1788622989.532041:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337408 00002000:00100000:3.0:1788622989.532119:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff997e371e0a80 x1875506858337408/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:65/0 lens 504/0 e 0 to 0 dl 1788623000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622989.532132:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e371e0a80 with x1875506858337408 ext(0->8) 00002000:00010000:3.0:1788622989.532140:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e371e0a80 00000100:00100000:3.0:1788622989.532180:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:3.0:1788622989.532192:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858337408:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788622989.539217:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858337408:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 Request processed in 7017us (7650us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788622989.539233:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00002000:00100000:3.0:1788622989.539246:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff997e371e0a80 x1875506858337408/t4294967302(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:65/0 lens 504/448 e 0 to 0 dl 1788623000 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622989.539257:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e371e0a80 with x1875506858337408 ext(0->8) 00002000:00010000:3.0:1788622989.539264:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e371e0a80 00000100:00100000:0.0:1788622989.548900:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.548983:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337536 00000100:00100000:3.0:1788622989.548995:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337536 00000100:00100000:3.0:1788622989.549081:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:3.0:1788622989.549091:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10440:x1875506858337536:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788622989.586851:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:2.0:1788622989.586883:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:2.0:1788622989.586896:0:5831:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1788622989.586923:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788622989.586931:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788622989.587092:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866749696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788622989.587168:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788622989.587227:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788622989.587240:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788622989.587636:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10440:x1875506858337536:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 Request processed in 38542us (38745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622989.587652:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:0.0:1788622989.589034:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866749696 00000100:00100000:0.0:1788622989.589051:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866749696 00000100:00100000:1.0:1788622989.589211:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788622989.589222:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866749696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788622989.589416:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788622989.589420:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788622990 00002000:00010000:1.0:1788622989.589423:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788622989.589425:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788622989 -> 1788622990 00002000:00010000:1.0:1788622989.589427:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788622989.589502:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866749696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 283us (2334us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788622989.589510:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788622989.589576:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788622989.589659:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997d07708000/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788622989.589667:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866749696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788622989.590825:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622989.590859:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337664 00000100:00100000:1.0:1788622989.590866:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337664 00000100:00100000:1.0:1788622989.590914:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:1.0:1788622989.590924:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858337664:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788622989.675852:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788622989.675873:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788622989.676040:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858337664:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 Request processed in 85109us (85215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622989.676060:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:3.0:1788622989.685644:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622989.685736:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858337920 00000100:00100000:0.0:1788622989.685780:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858337920 00000100:00100000:0.0:1788622989.685836:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:0.0:1788622989.685845:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10440:x1875506858337920:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788622989.685897:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622989.685939:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e867 expref: 13 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.685963:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:0.0:1788622989.685969:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788622989.686001:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.686016:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.686026:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788622989.686301:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5062d36 reply state 00000000fb8fb0df transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.686312:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788622989.686420:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10440:x1875506858337920:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 574us (832us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788622989.686429:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:0.0:1788622989.690349:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:1.0:1788622989.690415:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.690428:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.690435:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.690442:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622989.690448:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.690456:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.690474:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:1.0:1788622989.690477:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622989.690482:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622989.690488:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6cc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622989.690525:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858338048 00000100:00100000:1.0:1788622989.690534:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858338048 00000100:00100000:0.0:1788622989.694676:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:0.0:1788622989.694707:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858338048:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788622989.695032:0:8422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788622989.695036:0:8422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788622990 -> 1788622989 00002000:00010000:0.0:1788622989.695039:0:8422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788622987 00002000:00010000:0.0:1788622989.695042:0:8422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788622990 -> 1788622989 00002000:00010000:0.0:1788622989.695044:0:8422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788622989.695124:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858338048:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 426us (4788us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788622989.695132:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:0.0:1788622989.698175:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.698259:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858338304 00000100:00100000:2.0:1788622989.698270:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858338304 00000100:00100000:2.0:1788622989.698338:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:2.0:1788622989.698349:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10440:x1875506858338304:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788622989.698420:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.698439:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.698450:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.698488:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.698502:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 13 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.698531:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866749824:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622989.698627:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788622989.700401:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866749824:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622989.700438:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622989.701135:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.701208:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858338432 00000100:00100000:3.0:1788622989.701217:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858338432 00010000:00010000:3.0:1788622989.701252:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622989.701292:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:3.0:1788622989.701303:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2349:x1875506858338432:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622989.701317:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622989.701324:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.701337:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.701362:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6c8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e859 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.701378:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:3.0:1788622989.701383:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.701404:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.701413:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.701477:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622989.701533:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2349:x1875506858338432:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 232us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622989.701541:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 43 00010000:00010000:2.0:1788622989.704037:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704066:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704098:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704105:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704112:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704118:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622989.704122:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704130:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704147:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:2.0:1788622989.704151:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788622989.704156:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.704164:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6ccb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.704320:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:10440:x1875506858338304:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 Request processed in 5966us (6150us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788622989.704330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:1.0:1788622989.727449:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622989.727584:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858338560 00000100:00100000:2.0:1788622989.727594:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858338560 00000100:00100000:2.0:1788622989.727652:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:2.0:1788622989.727662:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858338560:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788622989.727713:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.727736:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.727762:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788622989.727768:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788622989.727772:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.727823:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.727838:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 7 pid: 6656 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.727853:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866749952:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622989.727948:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788622989.731534:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622989.731719:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858338688 00000100:00100000:0.0:1788622989.731729:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858338688 00010000:00010000:0.0:1788622989.731807:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 8 pid: 6656 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.731841:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:0.0:1788622989.731851:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858338688:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788622989.731865:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622989.731889:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 8 pid: 6656 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.731904:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 8 pid: 6656 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.731931:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788622989.731935:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788622989.731953:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.731963:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.731985:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622989.732042:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858338688:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 192us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622989.732049:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 44 00010000:00010000:2.0:1788622989.732264:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d6cbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e875 expref: 7 pid: 6656 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.732280:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866749952:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622989.732312:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732322:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732330:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732356:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732365:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732372:0:6656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732379:0:6656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788622989.732384:0:6656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732403:0:6656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732416:0:6656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.732423:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6cd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.732486:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858338560:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 Request processed in 4825us (5047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.732494:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:1.0:1788622989.743856:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622989.743948:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858338944 00000100:00100000:0.0:1788622989.743960:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858338944 00000100:00100000:0.0:1788622989.744041:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:0.0:1788622989.744063:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:10440:x1875506858338944:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788622989.744167:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744188:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744201:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744478:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744490:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744499:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744540:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.744554:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 13 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.744570:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866750080:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622989.744663:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622989.750184:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.750327:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858339072 00000100:00100000:3.0:1788622989.750338:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858339072 00010000:00010000:3.0:1788622989.750380:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622989.750420:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:3.0:1788622989.750429:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858339072:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622989.750444:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622989.750451:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.750466:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 14 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.750489:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:3.0:1788622989.750495:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.750523:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.750531:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622989.750552:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622989.750617:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858339072:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 188us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622989.750624:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 45 00010000:00010000:0.0:1788622989.751505:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e860 expref: 13 pid: 5810 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.751527:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866750080:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788622989.751550:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.751560:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.751566:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788622989.752013:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788622989.752183:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788622989.752226:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788622989.752321:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866750208:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788622989.752383:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622989.752417:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788622989.752557:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866750208 00000100:00100000:2.0:1788622989.752564:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866750208 00000100:00100000:2.0:1788622989.752613:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788622989.752622:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875506866750208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788622989.752708:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875506866750208:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622989.752715:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788622989.752822:0:5809:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788622989.752828:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997d07708000, transno 4294967303 00000100:00100000:0.0:1788622989.752837:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866750208:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788622989.753352:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788622989.753411:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866750336:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788622989.753444:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622989.753462:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788622989.753992:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866750336 00000100:00100000:2.0:1788622989.754000:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866750336 00000100:00100000:2.0:1788622989.754032:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788622989.754041:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875506866750336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788622989.754225:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1875506866750336:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (778us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788622989.754240:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788622989.754579:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866750336:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788622989.754618:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754630:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754638:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754644:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.754650:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754657:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754688:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097300) 00010000:00010000:0.0:1788622989.754692:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788622989.754698:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754705:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d6ce0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754963:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754971:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754978:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754984:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.754987:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.754993:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755003:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788622989.755006:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788622989.755009:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755015:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6c15 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755039:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755064:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755073:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755110:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.755125:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 16 pid: 5811 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.755139:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866750464:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622989.755215:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622989.760349:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622989.760400:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866750464:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788622989.760430:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.760554:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858339200 00000100:00100000:2.0:1788622989.760563:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858339200 00010000:00010000:2.0:1788622989.760600:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 17 pid: 5811 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.760641:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:2.0:1788622989.760650:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:2348:x1875506858339200:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622989.760666:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622989.760673:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 17 pid: 5811 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.760686:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 17 pid: 5811 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.760707:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d6c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e844 expref: 17 pid: 5811 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.760724:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:2.0:1788622989.760728:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.760840:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.760852:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.760884:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788622989.760898:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760905:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760916:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760922:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760928:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.760933:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:2348:x1875506858339200:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 285us (599us total) trans 0 rc 0/0 00010000:00010000:0.0:1788622989.760934:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.760938:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622989.760940:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 46 00010000:00010000:0.0:1788622989.760952:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760961:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788622989.760964:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622989.760967:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760973:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d6ce7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760982:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760988:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760994:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.760998:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622989.761000:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.761005:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.761012:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788622989.761014:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788622989.761016:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.761033:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d6cd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622989.761270:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10440:x1875506858338944:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 17218us (17428us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788622989.761279:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 83 00000020:00080000:0.0:1788622989.761283:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788622989.761658:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788622989.761664:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788622989.761692:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788622989.761698:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788622989.765205:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622989.765291:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858339456 00000100:00100000:3.0:1788622989.765302:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858339456 00000100:00100000:3.0:1788622989.765362:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:3.0:1788622989.765372:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10440:x1875506858339456:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788622989.767389:0:5813:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788622989.767514:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788622989.767586:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.767605:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.767617:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.767625:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.767632:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.767638:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622989.768017:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788622989.768154:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:10440:x1875506858339456:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 2779us (2957us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788622989.768164:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000020:00080000:2.0:1788622989.768170:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788622989.768254:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622989.768262:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.768624:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622989.768628:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.768637:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.768650:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff997e07097800) 00010000:00010000:0.0:1788622989.768653:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788622989.768659:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.768674:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6cee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622989.768693:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622989.768696:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622989.768697:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788622990.074265:0:11963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788622990.074851:0:11963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788622990.074901:0:11963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788622990.074907:0:11963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788622990.258923:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622990.290346:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.291429:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858339712 00000100:00100000:1.0:1788622990.291444:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858339712 00000100:00100000:1.0:1788622990.291533:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 84 00000100:00100000:1.0:1788622990.291553:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:10450:x1875506858339712:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622990.291581:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622990.291605:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e87c expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.291711:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6cfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.291727:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.291739:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622990.291778:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788622990.291904:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e87c expref: 20 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.291923:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6cfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e87c expref: 19 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.291931:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622990.291945:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788622990.291950:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285600, rc 0) 00000100:00100000:1.0:1788622990.292013:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10450:x1875506858339712:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 471us (1681us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788622990.292020:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 84 00000100:00080000:0.0:1788622990.292307:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622990.300951:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.301070:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858339840 00000100:00100000:2.0:1788622990.301080:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858339840 00000100:00100000:2.0:1788622990.301140:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 85 00000100:00100000:2.0:1788622990.301150:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10450:x1875506858339840:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:2.0:1788622990.301245:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301263:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301285:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301301:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301309:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301316:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301572:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301581:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301600:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788622990.301643:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301656:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301663:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301670:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301676:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622990.301680:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301688:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301699:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622990.301702:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622990.301706:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301712:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301725:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301737:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301777:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301783:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622990.301786:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301792:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301801:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097700) 00010000:00010000:2.0:1788622990.301804:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622990.301807:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301813:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301828:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301834:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301839:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301844:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622990.301853:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301860:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301868:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e07097200) 00010000:00010000:2.0:1788622990.301870:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622990.301873:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.301879:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622990.301966:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10450:x1875506858339840:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 815us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622990.301976:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 85 00000100:00100000:1.0:1788622990.433047:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.436184:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858340096 00000100:00100000:1.0:1788622990.436201:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858340096 00000100:00100000:1.0:1788622990.436269:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 86 00000100:00100000:1.0:1788622990.436280:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:10453:x1875506858340096:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622990.436302:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622990.436327:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6d1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e883 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.436405:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.436422:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.436435:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.436451:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.436458:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.436464:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437053:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437063:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437071:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622990.437082:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788622990.437171:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437178:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437185:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437191:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622990.437196:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437204:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437215:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622990.437218:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622990.437222:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437240:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285800/0xef842f43731d6d26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437254:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437259:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437266:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437270:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622990.437273:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437279:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437286:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11991000) 00010000:00010000:1.0:1788622990.437288:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622990.437291:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437296:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437341:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 22 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437355:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 21 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.437369:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:1.0:1788622990.437371:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788622990.437374:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07284800, rc 0) 00000100:00100000:1.0:1788622990.437511:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10453:x1875506858340096:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1231us (4481us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788622990.437519:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 86 00000100:00100000:0.0:1788622990.459416:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.459502:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858340224 00000100:00100000:2.0:1788622990.459510:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858340224 00000100:00100000:2.0:1788622990.459569:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:2.0:1788622990.459579:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10453:x1875506858340224:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:2.0:1788622990.459656:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459675:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459699:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459729:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459786:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459793:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459800:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622990.459805:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459813:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459825:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:2.0:1788622990.459828:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788622990.459832:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.459839:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622990.459909:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10453:x1875506858340224:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 330us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622990.459916:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:0.0:1788622990.469365:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.469454:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858340480 00000100:00100000:1.0:1788622990.469464:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858340480 00000100:00100000:1.0:1788622990.469526:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788622990.469538:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10453:x1875506858340480:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788622990.469843:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:10453:x1875506858340480:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 306us (491us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788622990.469852:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788622990.582438:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.582559:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858340736 00000100:00100000:2.0:1788622990.582570:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858340736 00000100:00100000:2.0:1788622990.582632:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 88 00000100:00100000:2.0:1788622990.582644:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:9981:x1875506858340736:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788622990.582669:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622990.582707:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e88a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.582857:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.582873:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 23 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.582882:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.582917:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 23 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.582931:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 23 pid: 6676 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622990.582945:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866750592:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622990.583068:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788622990.593940:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866750592:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622990.593988:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622990.605469:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622990.605612:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858340864 00000100:00100000:3.0:1788622990.605624:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858340864 00010000:00010000:3.0:1788622990.605673:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 24 pid: 6676 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622990.605831:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:3.0:1788622990.605843:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:2348:x1875506858340864:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622990.605861:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622990.605869:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 24 pid: 6676 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622990.605883:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 24 pid: 6676 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622990.605923:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e883 expref: 24 pid: 6676 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622990.605942:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:3.0:1788622990.605947:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622990.606187:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622990.606196:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622990.606355:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622990.606423:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:2348:x1875506858340864:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 581us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622990.606431:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 47 00010000:00010000:2.0:1788622990.614431:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.614451:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622990.614504:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788622990.616041:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6d49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.616078:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 23 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.616089:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:2.0:1788622990.616092:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788622990.616097:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788622990.616252:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:9981:x1875506858340736:12345-192.168.204.19@tcp:101:bash.0 Request processed in 33609us (33828us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788622990.616263:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 88 00000100:00100000:1.0:1788622990.624485:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.624581:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858341120 00000100:00100000:2.0:1788622990.624593:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858341120 00000100:00100000:2.0:1788622990.624663:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 89 00000100:00100000:2.0:1788622990.624674:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:9981:x1875506858341120:12345-192.168.204.19@tcp:36:bash.0 00010000:00010000:2.0:1788622990.627205:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.627236:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.627251:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622990.627638:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788622990.627692:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cffbfa3 reply state 00000000b5a8c23f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622990.627703:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788622990.628222:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788622990.628457:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:9981:x1875506858341120:12345-192.168.204.19@tcp:36:bash.0 Request processed in 3780us (3984us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788622990.628467:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 89 00000020:00080000:2.0:1788622990.628472:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788622990.635808:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:1.0:1788622990.635915:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.635929:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.635936:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.635943:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622990.635976:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.635985:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.636001:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:1.0:1788622990.636004:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622990.636009:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.636017:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6d5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622990.636065:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858341248 00000100:00100000:1.0:1788622990.636074:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858341248 00000100:00100000:1.0:1788622990.636133:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 90 00000100:00100000:1.0:1788622990.636143:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:9981:x1875506858341248:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788622990.636168:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622990.636196:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e891 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.636255:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e891 expref: 27 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.636345:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e891 expref: 27 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.636368:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:1.0:1788622990.636370:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788622990.636380:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285400, rc 0) 00000100:00100000:1.0:1788622990.636444:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:9981:x1875506858341248:12345-192.168.204.19@tcp:101:bash.0 Request processed in 302us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622990.636452:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 90 00000100:00100000:0.0:1788622990.648464:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.648571:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858341376 00000100:00100000:1.0:1788622990.649496:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858341376 00000100:00100000:1.0:1788622990.649634:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:1.0:1788622990.649645:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:9981:x1875506858341376:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788622990.649664:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622990.649688:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e898 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788622990.649720:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c388d, atime: 0x6a9c388b, ctime: 0x6a9c388d, blocks: 0xb 00010000:00010000:1.0:1788622990.649780:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1788622990.649785:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622990.649794:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.649824:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 7 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.649837:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e07285800, rc 0) 00000100:00100000:1.0:1788622990.649899:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:9981:x1875506858341376:12345-192.168.204.19@tcp:101:bash.0 Request processed in 255us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622990.649906:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:1.0:1788622990.657860:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622990.657945:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858341504 00000100:00100000:3.0:1788622990.657956:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858341504 00002000:00010000:3.0:1788622990.658014:0:6660:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788622990.658019:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e03290700 with x1875506858341504 ext(0->18446744073709551615) 00002000:00010000:3.0:1788622990.658042:0:6660:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e03290700. 00000100:00100000:3.0:1788622990.658105:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:3.0:1788622990.658117:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858341504:12345-192.168.204.19@tcp:10:bash.0 00002000:00010000:3.0:1788622990.658435:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788622990.658439:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788622989 -> 1788622991 00002000:00010000:3.0:1788622990.658441:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788622987 -> 1788622987 00002000:00010000:3.0:1788622990.658459:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788622989 -> 1788622991 00002000:00010000:3.0:1788622990.658461:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788622990.658525:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858341504:12345-192.168.204.19@tcp:10:bash.0 Request processed in 411us (680us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788622990.658533:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00002000:00010000:3.0:1788622990.658536:0:6660:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788622990.658539:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e03290700 with x1875506858341504 ext(0->18446744073709551615) 00002000:00010000:3.0:1788622990.658544:0:6660:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e03290700. 00000100:00100000:2.0:1788622990.754178:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622990.754296:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858341632 00000100:00100000:0.0:1788622990.754307:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858341632 00000100:00100000:0.0:1788622990.754370:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 91 00000100:00100000:0.0:1788622990.754381:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10467:x1875506858341632:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:0.0:1788622990.754466:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.754484:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.754497:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.754513:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.754520:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.754527:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755251:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755264:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755282:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788622990.755325:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755337:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755344:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755352:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755358:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622990.755362:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755371:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755385:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622990.755388:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622990.755394:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755400:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6d73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755413:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755426:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755444:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755450:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622990.755453:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755461:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755469:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e05312100) 00010000:00010000:0.0:1788622990.755472:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622990.755475:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755482:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6d7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755499:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755505:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755511:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755517:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788622990.755526:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755533:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755541:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:0.0:1788622990.755544:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622990.755547:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622990.755552:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d6d81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622990.755697:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10467:x1875506858341632:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 1315us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622990.755707:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 91 00000040:00080000:2.0:1788622990.765008:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788622990.765022:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788622990.765077:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788622990.765084:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788622990.836093:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.836459:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858341888 00000100:00100000:1.0:1788622990.836488:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858341888 00000100:00100000:1.0:1788622990.836553:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 92 00000100:00100000:1.0:1788622990.836563:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:10470:x1875506858341888:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622990.836586:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622990.836611:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6d88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e89f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.836694:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.836709:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.836721:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.836737:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.836772:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.836779:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837089:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837100:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837108:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622990.837127:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788622990.837529:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837539:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837546:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837553:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622990.837559:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837568:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837581:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622990.837585:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622990.837590:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837597:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6d8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837612:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837618:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837634:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837639:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622990.837641:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837648:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837655:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11991e00) 00010000:00010000:1.0:1788622990.837658:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622990.837661:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837667:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6d96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837711:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e89f expref: 30 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837725:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e89f expref: 29 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.837732:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:1.0:1788622990.837735:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788622990.837737:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e4100f400, rc 0) 00000100:00100000:1.0:1788622990.837975:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:10470:x1875506858341888:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1411us (1895us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788622990.837996:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 92 00000100:00100000:0.0:1788622990.842545:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.842650:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858342016 00000100:00100000:2.0:1788622990.842661:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858342016 00000100:00100000:2.0:1788622990.842725:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 93 00000100:00100000:2.0:1788622990.842736:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:10470:x1875506858342016:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:2.0:1788622990.842844:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.843047:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.843058:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.843095:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.843130:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 29 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622990.843147:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866750720:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622990.843255:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788622990.851050:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866750720:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622990.851088:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622990.854442:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.854559:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858342272 00000100:00100000:1.0:1788622990.854570:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858342272 00000100:00100000:1.0:1788622990.854635:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:1.0:1788622990.854645:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:5586:x1875506858342272:12345-192.168.204.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788622990.855026:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:5586:x1875506858342272:12345-192.168.204.19@tcp:35:ldlm_bl.0 Request processed in 381us (597us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788622990.855045:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:0.0:1788622990.862143:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.862443:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858342400 00000100:00100000:2.0:1788622990.862455:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858342400 00010000:00010000:2.0:1788622990.862503:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 31 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622990.862554:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:2.0:1788622990.862565:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:2349:x1875506858342400:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622990.862584:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622990.862592:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 31 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.862608:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 31 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.862634:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6d50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e88a expref: 31 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.862677:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:2.0:1788622990.862682:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.862693:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.862702:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.862798:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788622990.862918:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.862926:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.862960:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.862967:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.862973:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.862980:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622990.862985:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.862993:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.863014:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:1.0:1788622990.863017:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788622990.863021:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622990.863038:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622990.863117:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10470:x1875506858342016:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 20382us (20588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622990.863126:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 93 00000100:00100000:2.0:1788622990.863328:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:2349:x1875506858342400:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 764us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622990.863336:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:0.0:1788622990.865449:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622990.865533:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858342656 00000100:00100000:1.0:1788622990.865543:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858342656 00000100:00100000:1.0:1788622990.865599:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:1.0:1788622990.865609:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:10470:x1875506858342656:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788622990.866128:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10470:x1875506858342656:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 518us (688us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788622990.866136:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:1.0:1788622990.893553:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866750848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788622990.893634:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788622990.894076:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866750848 00000100:00100000:3.0:1788622990.894085:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866750848 00000100:00100000:3.0:1788622990.894143:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788622990.894154:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875506866750848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788622990.894183:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788622990.894248:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875506866750848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622990.894255:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788622990.894357:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866750848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788622990.976341:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.976654:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858342912 00000100:00100000:2.0:1788622990.976666:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858342912 00000100:00100000:2.0:1788622990.976778:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 94 00000100:00100000:2.0:1788622990.976789:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:10481:x1875506858342912:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:2.0:1788622990.976818:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622990.976840:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8a6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.976927:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.976942:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.976955:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.976988:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.976996:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977003:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977306:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6dc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977317:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977326:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622990.977338:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788622990.977451:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977459:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977466:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977472:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622990.977477:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977496:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977511:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622990.977514:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622990.977518:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977525:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6db9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977540:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977547:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977553:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977559:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622990.977562:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977568:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977574:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097200) 00010000:00010000:2.0:1788622990.977576:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622990.977580:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977594:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977636:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8a6 expref: 33 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977650:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8a6 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622990.977658:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:2.0:1788622990.977660:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622990.977662:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad000, rc 0) 00000100:00100000:2.0:1788622990.977802:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10481:x1875506858342912:12345-192.168.204.19@tcp:101:cat.0 Request processed in 954us (1417us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788622990.977811:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 94 00000100:00100000:0.0:1788622990.984739:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622990.984893:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858343168 00000100:00100000:2.0:1788622990.984904:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858343168 00000100:00100000:2.0:1788622990.984970:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:2.0:1788622990.984981:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10481:x1875506858343168:12345-192.168.204.19@tcp:35:cat.0 00000100:00100000:2.0:1788622990.985251:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10481:x1875506858343168:12345-192.168.204.19@tcp:35:cat.0 Request processed in 271us (538us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788622990.985601:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:0.0:1788622991.014104:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.014577:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858343424 00000100:00100000:1.0:1788622991.014588:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858343424 00000100:00100000:1.0:1788622991.014712:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 95 00000100:00100000:1.0:1788622991.014725:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10482:x1875506858343424:12345-192.168.204.19@tcp:36:rm.0 00010000:00010000:1.0:1788622991.014861:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788622991.014902:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6dc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8a6 expref: 33 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.014945:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e4100f400/0xef842f43731d6d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e89f expref: 32 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.014959:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285400/0xef842f43731d6d65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e891 expref: 31 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.014972:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991a00) 00010000:00010000:1.0:1788622991.014983:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788622991.015007:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015021:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015042:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015058:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015066:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015073:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015597:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015608:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.015625:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788622991.016580:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788622991.016593:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314971850128ns, next at 315971847232ns, rc = 0 00010000:00010000:1.0:1788622991.016682:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.016697:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.016708:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.016715:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.016723:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.016730:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017133:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788622991.017163:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017171:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017177:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017192:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.017197:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017206:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017219:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788622991.017222:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788622991.017226:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017232:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284800/0xef842f43731d6de3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017253:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017258:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017433:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017439:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.017442:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017449:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017469:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622991.017472:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622991.017475:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.017482:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284200/0xef842f43731d6dd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788622991.017494:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000906809f5 reply state 0000000073471ec8 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.017503:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788622991.017612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:10482:x1875506858343424:12345-192.168.204.19@tcp:36:rm.0 Request processed in 2884us (3518us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788622991.017622:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 95 00010000:00010000:3.0:1788622991.025236:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.025259:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.025267:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.025274:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622991.025279:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.025308:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.025327:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11991e00) 00010000:00010000:3.0:1788622991.025330:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788622991.025513:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788622991.025522:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.025539:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622991.025543:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.025551:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.025561:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff997e11991800) 00010000:00010000:0.0:1788622991.025564:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788622991.025569:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.025575:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d6dea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.025601:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622991.025603:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788622991.025605:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788622991.029011:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.029046:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07284c00/0xef842f43731d6ddc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.099415:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622991.099494:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858343680 00000100:00100000:2.0:1788622991.099506:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858343680 00000100:00100000:2.0:1788622991.099581:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 96 00000100:00100000:2.0:1788622991.099591:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:10488:x1875506858343680:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788622991.099634:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622991.099660:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6df1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8ad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.099828:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.099845:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.099858:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.099874:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.099881:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.099888:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788622991.100999:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788622991.102587:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102611:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102624:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102682:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102690:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102696:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102702:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622991.102706:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.102713:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.105651:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622991.105665:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622991.105676:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.105688:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6df8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788622991.105714:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000687c7ed4 reply state 00000000dd840ae0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622991.105726:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788622991.105910:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6df1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.105956:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 33 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.105965:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622991.105968:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622991.105970:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788622991.106072:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:10488:x1875506858343680:12345-192.168.204.19@tcp:101:bash.0 Request processed in 6480us (6668us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788622991.106081:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 96 00010000:00010000:1.0:1788622991.115847:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.115871:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.115879:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.115885:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.115890:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.115898:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.115932:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097200) 00010000:00010000:1.0:1788622991.115936:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622991.115940:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.115947:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6dff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.116380:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622991.116467:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858343808 00000100:00100000:0.0:1788622991.116477:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858343808 00000100:00100000:0.0:1788622991.116553:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:0.0:1788622991.116565:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858343808:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788622991.116583:0:6657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622991.116602:0:6657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8b4 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788622991.116630:0:6657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788622991.116651:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1788622991.116657:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788622991.116675:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 8 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.116697:0:6657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 8 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.116712:0:6657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8000, rc 0) 00000100:00100000:0.0:1788622991.116805:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858343808:12345-192.168.204.19@tcp:101:bash.0 Request processed in 242us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622991.116813:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00080000:3.0:1788622991.117022:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788622991.129202:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622991.129371:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858343936 00000100:00100000:0.0:1788622991.129383:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858343936 00000100:00100000:0.0:1788622991.129450:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:0.0:1788622991.129461:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:10488:x1875506858343936:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788622991.129480:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622991.129500:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8bb expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.129533:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.129542:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788622991.129546:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788622991.129551:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 9 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.129586:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.129617:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622991.129632:0:6655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3b009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6655:1875506866750976:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788622991.129776:0:6655:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622991.135240:0:6655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3b009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6655:1875506866750976:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788622991.135295:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 9 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.135317:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8600, rc 0) 00000100:00100000:0.0:1788622991.135387:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:10488:x1875506858343936:12345-192.168.204.19@tcp:101:bash.0 Request processed in 5928us (6212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622991.135396:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:2.0:1788622991.139445:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.139573:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858344064 00000100:00100000:1.0:1788622991.139583:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858344064 00010000:00010000:1.0:1788622991.139624:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.139706:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:1.0:1788622991.139715:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858344064:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622991.139782:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622991.139815:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.139829:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.139862:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc82fe9d/0xef842f43731d6e14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8b4 expref: 9 pid: 6657 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.139904:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622991.139909:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622991.139919:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.139929:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.139983:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.139998:0:5795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5795:1875506866751104:192.168.204.19@tcp:105: 00000100:00100000:1.0:1788622991.140085:0:5795:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36e06cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788622991.145199:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.145334:0:5795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5795:1875506866751104:192.168.204.19@tcp:105: 00010000:00010000:1.0:1788622991.145361:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622991.145427:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858344064:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 5712us (5996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622991.145439:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:3.0:1788622991.145919:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858344320 00000100:00100000:3.0:1788622991.145928:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858344320 00000100:00100000:3.0:1788622991.146020:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:3.0:1788622991.146040:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:10488:x1875506858344320:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:3.0:1788622991.146395:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:10488:x1875506858344320:12345-192.168.204.19@tcp:35:bash.0 Request processed in 356us (1210us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788622991.146403:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 25 00010000:00010000:0.0:1788622991.275965:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622991.374087:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622991.374199:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858344448 00000100:00100000:2.0:1788622991.374211:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858344448 00000100:00100000:2.0:1788622991.374291:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 97 00000100:00100000:2.0:1788622991.374301:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:10504:x1875506858344448:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788622991.374568:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622991.374594:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6e22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8c2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.374662:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.374679:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.374692:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622991.374796:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788622991.374800:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788622991.374821:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.375003:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6e22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8c2 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.375034:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8c2 expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.375043:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622991.375047:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788622991.375050:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788622991.375173:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+35:10504:x1875506858344448:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 872us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622991.375182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 97 00000100:00100000:0.0:1788622991.380834:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.381128:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858344704 00000100:00100000:1.0:1788622991.381138:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858344704 00000100:00100000:1.0:1788622991.381214:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 98 00000100:00100000:1.0:1788622991.381225:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+35:10504:x1875506858344704:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622991.381247:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622991.381280:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d6e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8c9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.382083:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d6e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.382102:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d6e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.382115:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d6e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.382128:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788622991.382489:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d6e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8c9 expref: 38 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.382511:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d6e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8c9 expref: 37 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.382521:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.382524:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788622991.382527:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dac00, rc 0) 00000100:00100000:1.0:1788622991.382672:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:10504:x1875506858344704:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1449us (1850us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788622991.382682:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 98 00000100:00100000:0.0:1788622991.391891:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622991.391944:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.392047:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858344960 00000100:00100000:1.0:1788622991.392058:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858344960 00000100:00100000:1.0:1788622991.392124:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 99 00000100:00100000:1.0:1788622991.392135:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:10504:x1875506858344960:12345-192.168.204.19@tcp:101:lfs.0 00000100:00100000:3.0:1788622991.392163:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345088 00000100:00100000:3.0:1788622991.392168:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345088 00010000:00010000:1.0:1788622991.392174:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788622991.392220:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00010000:00010000:1.0:1788622991.392220:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d6e45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8d0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622991.392227:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:2350:x1875506858345088:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622991.392239:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622991.392268:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d6e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8c9 expref: 39 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.392296:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622991.392302:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622991.392357:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:2350:x1875506858345088:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 130us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622991.392364:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00010000:00010000:1.0:1788622991.392600:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6e4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.392619:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.392631:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.392646:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788622991.392818:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d6e45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d0 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.392834:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d0 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.392853:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.392856:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788622991.392859:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db000, rc 0) 00000100:00100000:1.0:1788622991.392905:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:10504:x1875506858344960:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 772us (1030us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788622991.392912:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 99 00000100:00100000:0.0:1788622991.407968:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.408169:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345216 00000100:00100000:1.0:1788622991.408179:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345216 00000100:00100000:1.0:1788622991.408247:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:1.0:1788622991.408267:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858345216:12345-192.168.204.19@tcp:1:lfs.0 00010000:00010000:1.0:1788622991.408471:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.408494:0:6657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.408503:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622991.408507:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788622991.408512:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.408548:0:6657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.408564:0:6657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 8 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.408579:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6657:1875506866751232:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622991.408716:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36e069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622991.420443:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6657:1875506866751232:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788622991.420477:0:6657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622991.420599:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622991.420679:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345344 00000100:00100000:3.0:1788622991.420688:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345344 00002000:00100000:3.0:1788622991.420789:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff997e3b00b480 x1875506858345344/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:67/0 lens 504/0 e 0 to 0 dl 1788623002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622991.420799:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3b00b480 with x1875506858345344 ext(0->8) 00010000:00010000:3.0:1788622991.420809:0:6662:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 9 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.420824:0:6662:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 9 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788622991.420832:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997e3b00b480 00000100:00100000:3.0:1788622991.420862:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:3.0:1788622991.420872:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858345344:12345-192.168.204.19@tcp:4:lfs.0 00000100:00100000:3.0:1788622991.424696:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2348:x1875506858345344:12345-192.168.204.19@tcp:4:lfs.0 Request processed in 3809us (4082us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788622991.424725:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00002000:00100000:3.0:1788622991.425081:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff997e3b00b480 x1875506858345344/t4294967302(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:67/0 lens 504/448 e 0 to 0 dl 1788623002 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622991.425114:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3b00b480 with x1875506858345344 ext(0->8) 00010000:00010000:3.0:1788622991.425126:0:6662:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 11 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.425148:0:6662:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 11 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788622991.425156:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997e3b00b480 00000100:00100000:0.0:1788622991.436380:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622991.436517:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345472 00000100:00100000:3.0:1788622991.436528:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345472 00010000:00010000:3.0:1788622991.436572:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 11 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622991.436619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:3.0:1788622991.436628:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2351:x1875506858345472:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622991.436642:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788622991.436661:0:5796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788622991.436664:0:5796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788622991 00002000:00010000:3.0:1788622991.436666:0:5796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788622992 00002000:00010000:3.0:1788622991.436668:0:5796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788622991 00010000:00010000:3.0:1788622991.436674:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 11 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.436688:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 11 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.436781:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d6e1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8bb expref: 11 pid: 6655 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.436802:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788622991.436807:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788622991.436814:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.436825:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.436855:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622991.436917:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2351:x1875506858345472:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 289us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622991.436925:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 50 00010000:00010000:0.0:1788622991.437765:0:6657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437798:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437837:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437847:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437857:0:6657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437865:0:6657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dae00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788622991.437871:0:6657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437881:0:6657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437900:0:6657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.437909:0:6657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1c312f/0xef842f43731d6e5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622991.438010:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858345216:12345-192.168.204.19@tcp:1:lfs.0 Request processed in 29751us (30053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622991.438029:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:0.0:1788622991.447424:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.447833:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345728 00000100:00100000:1.0:1788622991.447844:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345728 00000100:00100000:1.0:1788622991.447902:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:1.0:1788622991.447929:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:10504:x1875506858345728:12345-192.168.204.19@tcp:35:lfs.0 00000004:00010000:1.0:1788622991.448010:0:5813:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d0 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788622991.448330:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788622991.448380:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788622991.448694:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788622991.449400:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.449424:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.449435:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.449473:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.449489:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 42 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.449506:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5813:1875506866751360:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622991.449600:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36e06180 going to sleep for 11 seconds 00000100:00100000:1.0:1788622991.461529:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5813:1875506866751360:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788622991.461565:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622991.465946:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622991.466902:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345856 00000100:00100000:3.0:1788622991.466917:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345856 00010000:00010000:3.0:1788622991.466963:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 43 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622991.467014:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:3.0:1788622991.467034:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+43:2348:x1875506858345856:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622991.467050:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622991.467056:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 43 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.467396:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 43 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.467420:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ad expref: 43 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.467437:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622991.467443:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.467453:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.467460:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.467494:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622991.467566:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+42:2348:x1875506858345856:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 534us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622991.467574:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00010000:00010000:1.0:1788622991.467650:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.467658:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788622991.468065:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788622991.468364:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788622991.468507:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5813:1875506866751488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788622991.468566:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622991.468606:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e206f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788622991.470037:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866751488 00000100:00100000:3.0:1788622991.470052:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866751488 00000100:00100000:3.0:1788622991.470181:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788622991.470192:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5813:x1875506866751488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788622991.470317:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5813:x1875506866751488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622991.470325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788622991.470497:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5813:1875506866751488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788622991.470997:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788622991.471087:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5813:1875506866751616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788622991.471132:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622991.471155:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788622991.471246:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866751616 00000100:00100000:1.0:1788622991.471262:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866751616 00000100:00100000:1.0:1788622991.471291:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788622991.471298:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5813:x1875506866751616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788622991.471473:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5813:x1875506866751616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 174us (339us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788622991.471480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788622991.471667:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5813:1875506866751616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788622991.471725:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788622991.471795:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.471821:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.471829:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.471835:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622991.471840:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.471848:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.471866:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622991.471869:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788622991.471874:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.471880:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d6e61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788622991.472076:0:5813:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788622991.472177:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788622991.472188:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315427445194ns, next at 316427443255ns, rc = 0 00000001:00080000:2.0:1788622991.472194:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788622991.472226:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622991.472229:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788622991.472236:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6e4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d0 expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622991.472422:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+45:10504:x1875506858345728:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 24495us (25011us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788622991.472430:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 26 00000020:00080000:2.0:1788622991.472434:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788622991.472713:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788622991.487245:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622991.487502:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858345984 00000100:00100000:2.0:1788622991.487513:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858345984 00000100:00100000:2.0:1788622991.487576:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 100 00000100:00100000:2.0:1788622991.487586:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+45:10504:x1875506858345984:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788622991.487612:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622991.487636:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6e68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8d7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.487708:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d7 expref: 46 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.487731:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d7 expref: 46 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.487788:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622991.487791:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788622991.487795:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bada00, rc 0) 00000100:00100000:2.0:1788622991.487850:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+46:10504:x1875506858345984:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 265us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622991.487857:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 100 00000100:00100000:3.0:1788622991.495845:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.495963:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858346240 00000100:00100000:1.0:1788622991.495972:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858346240 00000100:00100000:1.0:1788622991.496039:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:1.0:1788622991.496049:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+46:10504:x1875506858346240:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788622991.496305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+47:10504:x1875506858346240:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 256us (473us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788622991.496313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:0.0:1788622991.591300:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622991.591415:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.592805:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858346496 00000100:00100000:1.0:1788622991.592841:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858346496 00000100:00100000:1.0:1788622991.592948:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 136 00000100:00100000:1.0:1788622991.592959:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858346496:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788622991.593063:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858346496:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 106us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622991.593071:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 136 00000100:00080000:0.0:1788622991.593160:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622991.593519:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858346368 00000100:00100000:2.0:1788622991.593526:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858346368 00000100:00100000:2.0:1788622991.593651:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 290 00000100:00100000:2.0:1788622991.593660:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858346368:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622991.593766:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858346368:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 107us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622991.593774:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 290 00000100:00100000:0.0:1788622991.605231:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622991.605356:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858346624 00000100:00100000:2.0:1788622991.605369:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858346624 00000100:00100000:2.0:1788622991.605466:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 101 00000100:00100000:2.0:1788622991.605479:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+47:10514:x1875506858346624:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:2.0:1788622991.605594:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605616:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605629:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605645:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605652:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605658:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605840:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605873:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605881:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788622991.605938:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605954:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605962:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605969:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605976:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bac200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622991.605981:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.605991:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606005:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:2.0:1788622991.606011:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622991.606027:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606035:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606058:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606066:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606072:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606078:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622991.606081:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606088:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606097:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e07097400) 00010000:00010000:2.0:1788622991.606100:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622991.606103:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606110:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606126:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606130:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606135:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606150:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622991.606153:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606158:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606165:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622991.606168:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622991.606171:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.606177:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d6e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622991.606278:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+47:10514:x1875506858346624:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 799us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622991.606287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 101 00000100:00100000:0.0:1788622991.659843:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.659958:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858346880 00000100:00100000:1.0:1788622991.659973:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858346880 00000100:00100000:1.0:1788622991.660053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 102 00000100:00100000:1.0:1788622991.660064:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+47:10517:x1875506858346880:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622991.660087:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622991.660111:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6e84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8de expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660199:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660215:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660228:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660243:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660249:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660256:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660412:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d6e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660421:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660428:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.660440:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788622991.660553:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660561:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660568:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660574:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.660578:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660587:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660601:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622991.660603:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622991.660608:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660626:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660645:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660651:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660656:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660661:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.660664:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660670:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660677:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11991a00) 00010000:00010000:1.0:1788622991.660680:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622991.660682:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660689:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6e92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660807:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6e84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8de expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660826:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d6e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8de expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.660841:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.660845:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788622991.660848:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dbe00, rc 0) 00000100:00100000:1.0:1788622991.660913:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:10517:x1875506858346880:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 851us (1082us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788622991.660921:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 102 00000100:00100000:0.0:1788622991.669454:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.669938:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858347008 00000100:00100000:1.0:1788622991.669952:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858347008 00000100:00100000:1.0:1788622991.670101:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 103 00000100:00100000:1.0:1788622991.670115:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:10517:x1875506858347008:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:1.0:1788622991.670222:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670244:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670259:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670294:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670302:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670309:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670315:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.670339:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670361:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670376:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.670379:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788622991.670385:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.670393:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622991.670491:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:10517:x1875506858347008:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 379us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622991.670500:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 103 00000100:00100000:2.0:1788622991.672968:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.673039:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858347264 00000100:00100000:1.0:1788622991.673051:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858347264 00000100:00100000:1.0:1788622991.673125:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:1.0:1788622991.673137:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:10517:x1875506858347264:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788622991.673610:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:10517:x1875506858347264:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 473us (651us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788622991.673619:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:0.0:1788622991.790965:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.791105:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858347520 00000100:00100000:1.0:1788622991.791120:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858347520 00000100:00100000:1.0:1788622991.791202:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 104 00000100:00100000:1.0:1788622991.791215:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:10527:x1875506858347520:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788622991.791251:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622991.791262:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788622991.791301:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d6e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8c2 expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.791325:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622991.791332:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788622991.791350:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6eae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8e5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.791480:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6eb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.791498:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.791511:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.791525:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788622991.792061:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6eae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8e5 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.792081:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8e5 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.792090:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.792093:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788622991.792097:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db400, rc 0) 00000100:00100000:1.0:1788622991.792193:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:10527:x1875506858347520:12345-192.168.204.19@tcp:101:bash.0 Request processed in 980us (1240us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788622991.792213:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 104 00000100:00100000:0.0:1788622991.796155:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622991.796414:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858347776 00000100:00100000:2.0:1788622991.796427:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858347776 00000100:00100000:2.0:1788622991.797637:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 105 00000100:00100000:2.0:1788622991.797662:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:10527:x1875506858347776:12345-192.168.204.19@tcp:36:bash.0 00010000:00010000:2.0:1788622991.797873:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788622991.797911:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6eb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8e5 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.797942:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d6e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8de expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.797972:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622991.797979:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788622991.798654:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.798673:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.798688:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622991.798960:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788622991.798993:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b09209d5 reply state 0000000034c22a0c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622991.799002:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788622991.799197:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:10527:x1875506858347776:12345-192.168.204.19@tcp:36:bash.0 Request processed in 1544us (3052us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788622991.799208:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 105 00000020:00080000:2.0:1788622991.799215:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788622991.801204:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.801224:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.801233:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.801239:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bac200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622991.801255:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.801265:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.801286:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622991.801289:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622991.801295:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.801303:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d6ec3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622991.803149:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.803262:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858347904 00000100:00100000:1.0:1788622991.803274:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858347904 00000100:00100000:1.0:1788622991.803346:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 106 00000100:00100000:1.0:1788622991.803359:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:10527:x1875506858347904:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788622991.803392:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622991.803421:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8ec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.803547:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.803565:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.803579:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.803614:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788622991.803619:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788622991.803644:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.803682:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 53 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.803702:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.803736:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.803765:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788622991.803771:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da800, rc 0) 00000100:00100000:1.0:1788622991.803850:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:10527:x1875506858347904:12345-192.168.204.19@tcp:101:bash.0 Request processed in 493us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622991.803858:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 106 00000100:00100000:2.0:1788622991.811696:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.811998:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858348160 00000100:00100000:1.0:1788622991.812022:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858348160 00000100:00100000:1.0:1788622991.812136:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:1.0:1788622991.812149:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:10527:x1875506858348160:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:1.0:1788622991.813081:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+53:10527:x1875506858348160:12345-192.168.204.19@tcp:35:bash.0 Request processed in 927us (1391us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788622991.813094:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:3.0:1788622991.891047:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.891180:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858348288 00000100:00100000:1.0:1788622991.891204:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858348288 00000100:00100000:1.0:1788622991.891282:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 107 00000100:00100000:1.0:1788622991.891295:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+53:10533:x1875506858348288:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622991.891329:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622991.891361:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8f3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.891463:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.891481:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.891513:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.891798:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788622991.891803:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788622991.891829:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.891862:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8f3 expref: 55 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.891885:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8f3 expref: 54 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.891895:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622991.891898:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788622991.891903:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da200, rc 0) 00000100:00100000:1.0:1788622991.892092:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858348288:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 798us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622991.892100:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 107 00000100:00100000:3.0:1788622991.900097:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622991.900208:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858348416 00000100:00100000:1.0:1788622991.900221:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858348416 00000100:00100000:1.0:1788622991.900295:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 108 00000100:00100000:1.0:1788622991.900307:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858348416:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622991.900335:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622991.900363:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6ee6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e8fa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900805:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900825:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900838:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900856:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900862:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900869:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900986:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.900996:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901004:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622991.901060:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788622991.901065:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788622991.901087:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901116:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901127:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901134:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901141:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901148:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.901153:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901163:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901177:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:1.0:1788622991.901181:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622991.901702:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901720:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901736:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901846:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901864:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901869:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622991.901872:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901878:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901889:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11991a00) 00010000:00010000:1.0:1788622991.901892:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788622991.901895:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901901:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901951:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d6ee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8fa expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901967:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8fa expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622991.901974:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622991.901976:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788622991.901979:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0daa00, rc 0) 00000100:00100000:1.0:1788622991.902087:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10533:x1875506858348416:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1780us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622991.902106:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 108 00000100:00100000:2.0:1788622991.914684:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622991.914961:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858348544 00000100:00100000:3.0:1788622991.914975:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858348544 00000100:00100000:3.0:1788622991.915068:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:3.0:1788622991.915080:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:2349:x1875506858348544:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622991.915108:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622991.915144:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d6efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8fa expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.915169:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622991.915175:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622991.915274:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:2349:x1875506858348544:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 195us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622991.915283:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:0.0:1788622991.939257:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622991.939426:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858348800 00000100:00100000:2.0:1788622991.939579:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858348800 00000100:00100000:2.0:1788622991.939701:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 109 00000100:00100000:2.0:1788622991.939724:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858348800:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788622991.939780:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622991.939819:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e901 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.939943:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.939961:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.939973:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.940038:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622991.940054:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 55 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622991.940069:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e41d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866751744:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622991.940174:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788622991.950593:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622991.950631:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e41d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866751744:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788622991.950678:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622991.952461:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858348928 00000100:00100000:3.0:1788622991.952476:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858348928 00010000:00010000:3.0:1788622991.952523:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 56 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622991.952565:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:3.0:1788622991.952574:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:2348:x1875506858348928:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622991.952588:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622991.952594:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 56 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.952608:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 56 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.952632:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d6ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8ec expref: 56 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.952649:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622991.952663:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.952674:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.952682:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622991.952716:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788622991.954696:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.954716:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788622991.954792:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788622991.955044:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d6f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.955073:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.955084:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:0.0:1788622991.955087:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788622991.955091:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:3.0:1788622991.956191:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:2348:x1875506858348928:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 3604us (5601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622991.956207:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:0.0:1788622991.971947:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10533:x1875506858348800:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 32210us (32688us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788622991.971963:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 109 00000100:00100000:1.0:1788622991.994739:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622991.994978:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858349184 00000100:00100000:0.0:1788622991.994990:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858349184 00000100:00100000:0.0:1788622991.995072:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:0.0:1788622991.995084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10533:x1875506858349184:12345-192.168.204.19@tcp:103:lfs.0 00010000:00010000:0.0:1788622991.995100:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622991.995127:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d6e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8d7 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622991.995150:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:0.0:1788622991.995155:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622991.995218:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858349184:12345-192.168.204.19@tcp:103:lfs.0 Request processed in 137us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622991.995225:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000001:00080000:1.0:1788622992.005822:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788622992.005848:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788622992.005856:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788622992.008196:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622992.008261:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858349312 00000100:00100000:3.0:1788622992.008272:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858349312 00000100:00100000:3.0:1788622992.008345:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 110 00000100:00100000:3.0:1788622992.008355:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858349312:12345-192.168.204.19@tcp:58:lfs.0 00000100:00080000:0.0:1788622992.008435:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788622992.008987:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.009005:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.009714:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788622992.009946:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788622992.010149:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858349312:12345-192.168.204.19@tcp:58:lfs.0 Request processed in 1791us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622992.010158:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 110 00000100:00100000:3.0:1788622992.017276:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.017420:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858349440 00000100:00100000:1.0:1788622992.017431:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858349440 00000100:00100000:1.0:1788622992.017528:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 111 00000100:00100000:1.0:1788622992.017539:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:10533:x1875506858349440:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788622992.017564:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622992.017585:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e908 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.017646:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.017658:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 55 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.017678:0:6676:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.017691:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 55 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.017704:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:1.0:1788622992.017714:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788622992.017719:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 55 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.017728:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dba00, rc 0) 00000100:00100000:1.0:1788622992.017824:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10533:x1875506858349440:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 286us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.017831:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 111 00010000:00010000:1.0:1788622992.300254:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622992.427916:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788622992.427943:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866752256:0@lo:400:kworker.0 00000100:00100000:1.0:1788622992.428029:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622992.428101:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866751872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622992.428127:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622992.428144:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866752384:0@lo:400:kworker.0 00000100:00100000:1.0:1788622992.428167:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866751872 00000100:00100000:1.0:1788622992.428175:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866751872 00000100:00100000:2.0:1788622992.428176:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622992.428205:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866752128:0@lo:400:kworker.0 00000100:00100000:1.0:1788622992.428228:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788622992.428238:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866751872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788622992.428243:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622992.428258:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866752640:0@lo:400:kworker.0 00002000:00000024:1.0:1788622992.428267:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:2.0:1788622992.428274:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622992.428289:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788622992.428294:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866752000:0@lo:400:kworker.0 00000100:00100000:1.0:1788622992.428309:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866751872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.428315:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788622992.428334:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622992.428339:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866752384 00000100:00100000:1.0:1788622992.428343:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866752384 00000100:00100000:2.0:1788622992.428354:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866752512:0@lo:400:kworker.0 00000100:00100000:2.0:1788622992.428374:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622992.428374:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866752640 00000100:00100000:1.0:1788622992.428377:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866752640 00000100:00100000:1.0:1788622992.428393:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788622992.428399:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866752000 00000100:00100000:1.0:1788622992.428399:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866752384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622992.428401:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866752000 00000100:00100000:2.0:1788622992.428439:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788622992.428442:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866752384:12345-0@lo:400:kworker.0 Request processed in 43us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622992.428446:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866752000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788622992.428449:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788622992.428460:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788622992.428466:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866752640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622992.428479:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866752000:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622992.428485:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788622992.428487:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866752640:12345-0@lo:400:kworker.0 Request processed in 22us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.428492:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788622992.428515:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788622992.428524:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866752000:0@lo:400:kworker.0 00000100:00100000:1.0:1788622992.428533:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866752384:0@lo:400:kworker.0 00000100:00100000:2.0:1788622992.428534:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788622992.428539:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1788622992.428554:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e2f1c9c00, transno 4294967301 00000004:00080000:2.0:1788622992.428562:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1788622992.429380:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866752640:0@lo:400:kworker.0 00000100:00100000:3.0:1788622992.429514:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866752256 00000100:00100000:3.0:1788622992.429521:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866752256 00000100:00100000:3.0:1788622992.429573:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866752128 00000100:00100000:3.0:1788622992.429576:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866752128 00000100:00100000:3.0:1788622992.429587:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866752512 00000100:00100000:3.0:1788622992.429589:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866752512 00000100:00100000:3.0:1788622992.429604:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788622992.429611:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866752256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622992.429676:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866752256:12345-0@lo:400:kworker.0 Request processed in 65us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622992.429683:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788622992.430826:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788622992.430853:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866752128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622992.430935:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866752128:12345-0@lo:400:kworker.0 Request processed in 92us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622992.430952:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788622992.432202:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788622992.432236:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866752512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788622992.432314:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866752512:12345-0@lo:400:kworker.0 Request processed in 101us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622992.432322:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1788622992.432406:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622992.433311:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866751872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622992.433377:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866752256:0@lo:400:kworker.0 00000100:00100000:2.0:1788622992.436869:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866752512:0@lo:400:kworker.0 00000100:00100000:2.0:1788622992.437341:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866752128:0@lo:400:kworker.0 00000040:00080000:2.0:1788622992.812079:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788622992.812094:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788622992.812161:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788622992.812170:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788622992.812332:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e41d2a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866752768:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788622992.812479:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36e06180 going to sleep for 11 seconds 00000100:00100000:2.0:1788622992.815252:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e41d2a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866752768:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788622992.830788:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622992.831587:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858349568 00000100:00100000:3.0:1788622992.831602:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858349568 00000100:00100000:3.0:1788622992.831685:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 112 00000100:00100000:3.0:1788622992.831709:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10534:x1875506858349568:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788622992.831792:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788622992.831952:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10534:x1875506858349568:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 257us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622992.831963:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 112 00000100:00100000:2.0:1788622992.845959:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622992.846090:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858349696 00000100:00100000:3.0:1788622992.846104:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858349696 00000100:00100000:3.0:1788622992.846183:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 113 00000100:00100000:3.0:1788622992.846195:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10534:x1875506858349696:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788622992.846308:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.846329:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.846344:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849035:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849065:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849079:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849113:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849122:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849128:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622992.849197:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788622992.849202:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788622992.849216:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849228:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849235:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849242:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.849248:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622992.849253:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.851638:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.851671:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:3.0:1788622992.851674:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622992.851680:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.851690:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6f25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.851714:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853727:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853736:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853756:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622992.853761:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853773:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853791:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff997e11ed0400) 00010000:00010000:3.0:1788622992.853794:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622992.853799:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853805:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6f2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853833:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853839:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853844:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853849:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622992.853868:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853875:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853884:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622992.853886:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622992.853889:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.853895:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622992.854020:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10534:x1875506858349696:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 Request processed in 7821us (8067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622992.854032:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 113 00000100:00100000:1.0:1788622992.856883:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622992.857020:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858349952 00000100:00100000:3.0:1788622992.857030:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858349952 00000100:00100000:3.0:1788622992.857085:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 114 00000100:00100000:3.0:1788622992.857094:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:10534:x1875506858349952:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788622992.857118:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622992.857139:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6f3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e90f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857243:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857258:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857289:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622992.857301:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788622992.857430:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857438:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857445:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857452:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622992.857456:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857850:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857867:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622992.857870:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788622992.857875:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.857882:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.865098:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6f3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e90f expref: 57 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.865143:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:0.0:1788622992.865146:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788622992.865220:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d6f3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e90f expref: 57 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.865294:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735400, rc 0) 00000100:00100000:0.0:1788622992.865364:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:10534:x1875506858349952:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 8269us (8493us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788622992.865372:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 114 00000100:00100000:2.0:1788622992.871139:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.871398:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858350080 00000100:00100000:1.0:1788622992.871407:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858350080 00000100:00100000:1.0:1788622992.871566:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 115 00000100:00100000:1.0:1788622992.871578:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:10534:x1875506858350080:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788622992.871615:0:5809:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788622992.871797:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:10534:x1875506858350080:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 221us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.871804:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 115 00000100:00100000:2.0:1788622992.885153:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622992.885269:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858350336 00000100:00100000:0.0:1788622992.885280:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858350336 00000100:00100000:0.0:1788622992.885348:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 116 00000100:00100000:0.0:1788622992.885360:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:10534:x1875506858350336:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788622992.885382:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622992.885385:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788622992.885414:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d6edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e8f3 expref: 56 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.885435:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:0.0:1788622992.885441:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788622992.885456:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6f4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e916 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788622992.886039:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788622992.886233:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.886263:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.886275:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.886335:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d6f4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e916 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.886352:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e916 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.886360:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312100) 00010000:00010000:0.0:1788622992.886362:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788622992.886365:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9800, rc 0) 00000100:00100000:0.0:1788622992.886421:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:10534:x1875506858350336:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 1064us (1282us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788622992.886430:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 116 00000100:00100000:2.0:1788622992.898942:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622992.899100:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858350592 00000100:00100000:3.0:1788622992.899111:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858350592 00000100:00100000:3.0:1788622992.899174:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:3.0:1788622992.899200:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:10534:x1875506858350592:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788622992.899274:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622992.899303:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d6f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e916 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899324:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312100) 00010000:00010000:3.0:1788622992.899335:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788622992.899370:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899384:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899394:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899448:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899456:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899476:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899544:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899552:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899568:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899573:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622992.899577:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899584:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899593:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788622992.899597:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622992.899600:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899606:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6f64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899615:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899620:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899625:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899629:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622992.899631:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899646:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899653:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfe383bf7 (ffff997e11ed0400) 00010000:00010000:3.0:1788622992.899655:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622992.899658:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.899663:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfe383bf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622992.899826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:10534:x1875506858350592:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 628us (900us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788622992.899833:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:2.0:1788622992.903854:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622992.904185:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858350720 00000100:00100000:0.0:1788622992.904196:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858350720 00000100:00100000:0.0:1788622992.904270:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:0.0:1788622992.904280:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:10534:x1875506858350720:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788622992.904302:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622992.904328:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e91d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.904365:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.904397:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.904408:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.904517:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.904536:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.904544:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:0.0:1788622992.904547:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788622992.904550:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9c00, rc 0) 00000100:00100000:0.0:1788622992.904614:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:10534:x1875506858350720:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 336us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622992.904621:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:0.0:1788622992.912602:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622992.912865:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858350976 00000100:00100000:3.0:1788622992.912878:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858350976 00000100:00100000:3.0:1788622992.912943:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 119 00000100:00100000:3.0:1788622992.912954:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:10534:x1875506858350976:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788622992.913066:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.913084:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622992.913097:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788622992.913973:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788622992.913986:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316869243337ns, next at 317869240788ns, rc = 0 00000004:00010000:3.0:1788622992.914114:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f068419e reply state 00000000081b5b04 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622992.914126:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788622992.914673:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:10534:x1875506858350976:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1716us (2080us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788622992.914681:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 119 00000100:00100000:2.0:1788622992.921193:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:1.0:1788622992.921931:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.921946:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.921972:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.921977:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788622992.921983:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.922610:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.922633:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:1.0:1788622992.922637:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788622992.922642:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.922650:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d6f80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622992.923430:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858351104 00000100:00100000:0.0:1788622992.923447:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858351104 00000100:00100000:0.0:1788622992.923537:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 120 00000100:00100000:0.0:1788622992.923547:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:10534:x1875506858351104:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788622992.923576:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788622992.923597:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e924 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.923679:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.923694:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622992.923714:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:0.0:1788622992.923717:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788622992.923720:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8600, rc 0) 00000100:00100000:0.0:1788622992.923810:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:10534:x1875506858351104:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 265us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622992.923817:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 120 00000100:00100000:2.0:1788622992.934826:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.935066:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858351232 00000100:00100000:1.0:1788622992.935079:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858351232 00000100:00100000:1.0:1788622992.935172:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:1.0:1788622992.935183:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858351232:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788622992.935331:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622992.935601:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858351232:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 418us (789us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788622992.935609:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:2.0:1788622992.947675:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.948127:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858351488 00000100:00100000:1.0:1788622992.948137:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858351488 00000100:00100000:1.0:1788622992.948314:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:1.0:1788622992.948326:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:10534:x1875506858351488:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788622992.948592:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:10534:x1875506858351488:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 268us (932us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788622992.948600:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:2.0:1788622992.954635:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.955535:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858351744 00000100:00100000:1.0:1788622992.955548:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858351744 00000100:00100000:1.0:1788622992.955623:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 121 00000100:00100000:1.0:1788622992.955634:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:10534:x1875506858351744:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788622992.955884:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:10534:x1875506858351744:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 251us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.955892:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 121 00000100:00100000:2.0:1788622992.959900:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.960458:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858351872 00000100:00100000:1.0:1788622992.960470:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858351872 00000100:00100000:1.0:1788622992.960583:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 122 00000100:00100000:1.0:1788622992.960595:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:10534:x1875506858351872:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788622992.960616:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622992.960639:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e92b expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.960723:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.960739:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.960803:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788622992.960863:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788622992.960883:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.960910:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d6f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e92b expref: 62 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.960929:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e92b expref: 61 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.960938:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:1.0:1788622992.960940:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788622992.960944:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db800, rc 0) 00000100:00100000:1.0:1788622992.961013:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:10534:x1875506858351872:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 420us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.961020:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 122 00000100:00100000:0.0:1788622992.974802:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.975470:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352000 00000100:00100000:1.0:1788622992.975481:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352000 00000100:00100000:1.0:1788622992.975547:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:1.0:1788622992.975558:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858352000:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788622992.975577:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622992.975778:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e932 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788622992.975809:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c3891, blocks: 0x1 00010000:00010000:1.0:1788622992.975828:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1788622992.975847:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622992.975857:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 10 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.975876:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 10 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622992.975889:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da800, rc 0) 00000100:00100000:1.0:1788622992.982108:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2348:x1875506858352000:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 6534us (7360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.982123:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:2.0:1788622992.992293:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622992.992414:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352256 00000100:00100000:1.0:1788622992.992424:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352256 00000100:00100000:1.0:1788622992.992528:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00100000:1.0:1788622992.992539:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:10534:x1875506858352256:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788622992.992655:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:10534:x1875506858352256:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 117us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622992.992664:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00100000:2.0:1788622993.001938:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622993.002043:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352384 00000100:00100000:1.0:1788622993.002055:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352384 00000100:00100000:1.0:1788622993.002114:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:1.0:1788622993.002125:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:10534:x1875506858352384:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788622993.002144:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788622993.002163:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e939 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.002222:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.002233:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622993.002248:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622993.002255:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.002291:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.002306:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.002320:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866752896:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622993.002412:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2044a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622993.007496:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866752896:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788622993.007546:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.007568:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db600, rc 0) 00000100:00100000:1.0:1788622993.007630:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:10534:x1875506858352384:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 5506us (5705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622993.007639:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:0.0:1788622993.008096:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622993.008222:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352512 00000100:00100000:1.0:1788622993.008229:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352512 00010000:00010000:1.0:1788622993.008264:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.008342:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:1.0:1788622993.008354:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2348:x1875506858352512:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622993.008369:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622993.008392:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.008407:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.008431:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d6f9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e932 expref: 11 pid: 6655 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.008447:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622993.008452:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622993.008460:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 10 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.008470:0:7602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 10 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.014293:0:7602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 10 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.014350:0:7602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7602:1875506866753024:192.168.204.19@tcp:105: 00000100:00100000:1.0:1788622993.014473:0:7602:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2044a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622993.025893:0:7602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7602:1875506866753024:192.168.204.19@tcp:105: 00010000:00010000:1.0:1788622993.025923:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622993.025996:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2348:x1875506858352512:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 17634us (17891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622993.026009:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:3.0:1788622993.030582:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622993.031131:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352640 00000100:00100000:0.0:1788622993.031142:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352640 00002000:00100000:0.0:1788622993.031198:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff997e2f190a80 x1875506858352640/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:69/0 lens 504/0 e 0 to 0 dl 1788623004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788622993.031209:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e2f190a80 with x1875506858352640 ext(0->12) 00002000:00010000:0.0:1788622993.031215:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e2f190a80 00000100:00100000:0.0:1788622993.031262:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:0.0:1788622993.031272:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2349:x1875506858352640:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788622993.032046:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:2349:x1875506858352640:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 Request processed in 770us (1475us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788622993.032065:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00002000:00100000:0.0:1788622993.032074:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff997e2f190a80 x1875506858352640/t4294967308(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:69/0 lens 504/448 e 0 to 0 dl 1788623004 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788622993.032083:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e2f190a80 with x1875506858352640 ext(0->12) 00002000:00010000:0.0:1788622993.032088:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e2f190a80 00000100:00100000:2.0:1788622993.043892:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622993.044192:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352768 00000100:00100000:0.0:1788622993.044202:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352768 00000100:00100000:0.0:1788622993.044266:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 124 00000100:00100000:0.0:1788622993.044277:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:10534:x1875506858352768:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788622993.119145:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:1.0:1788622993.119183:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e3ccc1e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788622993.119188:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e09625300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e3ccc1180 00000020:00080000:1.0:1788622993.119192:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e09625100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997e37477400 00000001:00080000:1.0:1788622993.119223:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788622993.119260:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788622993.119289:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788622993.119309:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e096d4900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788622993.119312:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e20684100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e096d4cc0 00000020:00080000:1.0:1788622993.119315:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e20684a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997e08545000 00000004:00080000:1.0:1788622993.119344:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1788622993.119449:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788622993.119474:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866753152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788622993.119633:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788622993.119875:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866753152 00000100:00100000:1.0:1788622993.119885:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866753152 00000100:00100000:1.0:1788622993.119971:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788622993.119982:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866753152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788622993.120032:0:6657:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788622993.120081:0:6657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c388f, atime: 0x6a9c3890, ctime: 0x6a9c388f, blocks: 0xb 00010000:00010000:1.0:1788622993.120092:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.120113:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1788622993.120120:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788622993.120129:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.120151:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.120162:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.120172:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.120194:0:6657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788622993.120868:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10534:x1875506858352768:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 Request processed in 76587us (76985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622993.120880:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 124 00000020:00080000:2.0:1788622993.121655:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788622993.121861:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788622993.122011:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e41d2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866753408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788622993.122072:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622993.122135:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866753408 00000100:00100000:2.0:1788622993.122143:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866753408 00000100:00100000:2.0:1788622993.122182:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788622993.122191:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866753408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788622993.122329:0:8422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788622993.122334:0:8422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788622993 00002000:00010000:2.0:1788622993.122336:0:8422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788622993.122339:0:8422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788622993 -> 1788622993 00002000:00010000:2.0:1788622993.122351:0:8422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788622993.122390:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3278:x1875506866753408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (317us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788622993.122396:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788622993.122443:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e41d2ad80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788622993.122450:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e41d2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866753408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788622993.122466:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e41d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866753280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788622993.122489:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622993.122512:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866753280 00000100:00100000:2.0:1788622993.122515:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866753280 00000100:00100000:2.0:1788622993.122535:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788622993.122541:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1875506866753280:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788622993.123315:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1875506866753152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3331us (3679us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788622993.123325:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788622993.123355:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788622993.123373:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788622993.123391:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.123405:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788622993.123411:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.123424:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.123449:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.123457:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bad5087/0xef842f43731d6faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.123479:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622993.123481:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788622993.123482:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788622993.123663:0:8422:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788622993.123908:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.123929:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 11 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.123939:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788622993.123944:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788622993.123950:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.124005:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 11 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.124041:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 11 pid: 8422 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.124059:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8422:1875506866753536:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622993.124153:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc46c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788622993.124209:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e2eec9500/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788622993.124216:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866753152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788622993.125558:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622993.125696:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858352896 00000100:00100000:1.0:1788622993.125707:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858352896 00000100:00100000:1.0:1788622993.125801:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:1.0:1788622993.125812:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:2350:x1875506858352896:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788622993.131495:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622993.131535:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858353024 00000100:00100000:0.0:1788622993.131558:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858353024 00010000:00010000:0.0:1788622993.131614:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 13 pid: 8422 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622993.131661:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 54 00000100:00100000:0.0:1788622993.131673:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2349:x1875506858353024:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788622993.131702:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788622993.131709:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 13 pid: 8422 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622993.131772:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 13 pid: 8422 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622993.131812:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788622993.131818:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788622993.131826:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622993.131837:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788622993.131862:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788622993.131945:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2349:x1875506858353024:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 274us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622993.131954:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 54 00010000:00010000:2.0:1788622993.132941:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f57393c/0xef842f43731d6d6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e898 expref: 12 pid: 8422 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.132977:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8422:1875506866753536:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622993.133018:0:8422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.133032:0:8422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.133041:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.133054:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.133083:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.133105:0:8422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788622993.133819:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3281:x1875506866753280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11274us (11324us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788622993.133828:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788622993.133973:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788622993.134002:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.134015:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788622993.134021:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.134032:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.134056:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.134065:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d6fb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.134091:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622993.134101:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622993.134104:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788622993.134146:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e41d28700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788622993.134154:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e41d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866753280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788622993.179510:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2350:x1875506858352896:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 Request processed in 53685us (53954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622993.179528:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 43 00000001:00080000:2.0:1788622993.179592:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788622993.179621:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788622993.185038:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622993.185138:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858353280 00000100:00100000:3.0:1788622993.185157:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858353280 00000100:00100000:3.0:1788622993.185238:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 125 00000100:00100000:3.0:1788622993.185250:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10534:x1875506858353280:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788622993.185310:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622993.185342:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d6f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e92b expref: 15 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.185365:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:3.0:1788622993.185370:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788622993.185404:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.185419:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.185427:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788622993.186531:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d64cec28 reply state 000000000f9c7308 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622993.186564:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788622993.186703:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:10534:x1875506858353280:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1452us (1672us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788622993.186712:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 125 00000100:00100000:0.0:1788622993.200255:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.200417:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858353408 00000100:00100000:2.0:1788622993.200431:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858353408 00000100:00100000:2.0:1788622993.200521:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:2.0:1788622993.200534:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2350:x1875506858353408:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788622993.200874:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788622993.200879:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788622993 -> 1788622992 00002000:00010000:2.0:1788622993.200881:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788622992 00002000:00010000:2.0:1788622993.200883:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788622993 -> 1788622992 00002000:00010000:2.0:1788622993.200886:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788622993.200967:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858353408:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 434us (723us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788622993.200975:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 44 00010000:00010000:3.0:1788622993.201799:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.201815:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.201824:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.201831:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622993.201837:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.201846:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.201869:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:3.0:1788622993.201872:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622993.201879:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.201886:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.206611:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.206967:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858353664 00000100:00100000:2.0:1788622993.206981:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858353664 00000100:00100000:2.0:1788622993.207107:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 126 00000100:00100000:2.0:1788622993.207121:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:10534:x1875506858353664:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788622993.207382:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.207420:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.207432:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.207479:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.207495:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 15 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.207512:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866753664:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788622993.207634:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622993.216318:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.216788:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866753664:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788622993.216836:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622993.218511:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858353792 00000100:00100000:3.0:1788622993.218528:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858353792 00010000:00010000:3.0:1788622993.218609:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622993.218911:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00100000:3.0:1788622993.218925:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:2349:x1875506858353792:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788622993.218945:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788622993.218954:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.218971:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.219011:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d6f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e91d expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.219034:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:3.0:1788622993.219040:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.219052:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.219062:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.219102:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788622993.219184:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:2349:x1875506858353792:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 262us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622993.219193:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 55 00010000:00010000:2.0:1788622993.219283:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219293:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219334:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219343:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219360:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219367:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622993.219372:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219382:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219391:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:2.0:1788622993.219394:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788622993.219398:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.219405:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.219456:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10534:x1875506858353664:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 Request processed in 12338us (12859us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788622993.219466:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 126 00000100:00100000:0.0:1788622993.241784:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622993.241893:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858353920 00000100:00100000:3.0:1788622993.241907:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858353920 00000100:00100000:3.0:1788622993.241997:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:3.0:1788622993.242011:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2351:x1875506858353920:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788622993.242076:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.242101:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.242110:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788622993.242115:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788622993.242121:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.242165:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.242182:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 7 pid: 6656 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622993.242199:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8422:1875506866753792:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622993.242321:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622993.245594:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8422:1875506866753792:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622993.245638:0:8422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622993.246366:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.246461:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858354048 00000100:00100000:2.0:1788622993.246471:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858354048 00010000:00010000:2.0:1788622993.246528:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 8 pid: 6656 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.246573:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 56 00000100:00100000:2.0:1788622993.246585:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858354048:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622993.246616:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622993.246647:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 8 pid: 6656 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.246664:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 8 pid: 6656 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.246709:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000894f0762/0xef842f43731d6fa3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e939 expref: 8 pid: 6656 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.246729:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788622993.246735:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788622993.246830:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.246842:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.246876:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622993.246997:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858354048:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 413us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622993.247004:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 56 00010000:00010000:3.0:1788622993.247352:0:8422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247364:0:8422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247397:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247407:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247416:0:8422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247423:0:8422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788622993.247428:0:8422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247439:0:8422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247453:0:8422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.247476:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d6fc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622993.247532:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858353920:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 Request processed in 5525us (5760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622993.247541:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:0.0:1788622993.254261:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622993.254418:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858354304 00000100:00100000:1.0:1788622993.254431:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858354304 00000100:00100000:1.0:1788622993.254527:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 127 00000100:00100000:1.0:1788622993.254538:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10534:x1875506858354304:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788622993.254651:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.254672:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.254702:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.255197:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.256072:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.256093:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.256150:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.256168:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 15 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.256186:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866753920:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788622993.257188:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2044a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788622993.266927:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866753920:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622993.266969:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622993.270361:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622993.270948:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858354432 00000100:00100000:1.0:1788622993.270962:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858354432 00010000:00010000:1.0:1788622993.271047:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.271098:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:1.0:1788622993.271109:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:2349:x1875506858354432:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788622993.271130:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788622993.271138:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.271154:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.271181:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8600/0xef842f43731d6f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e924 expref: 16 pid: 5811 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.271200:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:1.0:1788622993.271207:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.271218:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.271237:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.271337:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788622993.271413:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:2349:x1875506858354432:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 305us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622993.271422:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 57 00010000:00010000:2.0:1788622993.282713:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.282734:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788622993.283059:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788622993.283585:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788622993.283651:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788622993.283996:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866754048:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788622993.284092:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622993.284521:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788622993.290103:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866754048 00000100:00100000:1.0:1788622993.290123:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866754048 00000100:00100000:1.0:1788622993.290274:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788622993.290288:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1875506866754048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788622993.290469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1875506866754048:12345-0@lo:1000:mdt00_000.0 Request processed in 184us (6377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622993.290477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788622993.290559:0:5809:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788622993.290567:0:5809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788622993.290593:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e41d2ad80, transno 4294967309 00000100:00100000:2.0:1788622993.290621:0:5809:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff997e41d28700 x1875506866753280/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788623009 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788622993.290636:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866754048:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788622993.291252:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788622993.291357:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866754176:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788622993.291412:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622993.300411:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788622993.301529:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866754176 00000100:00100000:3.0:1788622993.301546:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866754176 00000100:00100000:3.0:1788622993.301627:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788622993.301639:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1875506866754176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788622993.302577:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5809:x1875506866754176:12345-0@lo:1000:mdt00_000.0 Request processed in 935us (11160us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788622993.302588:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788622993.303046:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5809:1875506866754176:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788622993.303105:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303118:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303127:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303134:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622993.303152:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303162:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303183:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e05312e00) 00010000:00010000:2.0:1788622993.303186:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788622993.303192:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303200:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d6fd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303251:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303258:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303264:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303270:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622993.303273:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303279:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303289:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622993.303292:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788622993.303307:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 18 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303320:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 18 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303330:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 18 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.303375:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 18 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.303391:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f1c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866754304:192.168.204.19@tcp:105: 00000100:00100000:2.0:1788622993.303496:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788622993.307370:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.307486:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f1c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866754304:192.168.204.19@tcp:105: 00010000:00010000:2.0:1788622993.307531:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307544:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d6f17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307590:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307610:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307625:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307659:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307666:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307673:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307685:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622993.307699:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307707:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307721:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622993.307725:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788622993.307729:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307735:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d6fdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307779:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307786:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307792:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307803:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622993.307806:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307812:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307821:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622993.307823:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788622993.307826:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.307832:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d6fcd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.308133:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:10534:x1875506858354304:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 53593us (53882us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788622993.308145:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 127 00000020:00080000:2.0:1788622993.308153:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788622993.308600:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858354560 00000100:00100000:3.0:1788622993.308612:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858354560 00000100:00100000:3.0:1788622993.308680:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:3.0:1788622993.308704:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:10533:x1875506858354560:12345-192.168.204.19@tcp:49:lfs.0 00000100:00100000:3.0:1788622993.308864:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:10533:x1875506858354560:12345-192.168.204.19@tcp:49:lfs.0 Request processed in 175us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622993.308871:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 31 00000040:00080000:1.0:1788622993.309605:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788622993.309613:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788622993.310924:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788622993.310945:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788622993.324117:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:1.0:1788622993.324402:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622993.324513:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858354816 00000100:00100000:3.0:1788622993.324527:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858354816 00000100:00100000:3.0:1788622993.324600:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:3.0:1788622993.324613:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:10534:x1875506858354816:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788622993.325948:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788622993.326097:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788622993.326916:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.326941:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.326956:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.326966:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.326974:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.326993:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.327096:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788622993.327261:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10534:x1875506858354816:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 2644us (3150us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788622993.327273:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 32 00000020:00080000:3.0:1788622993.327281:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788622993.329046:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:1.0:1788622993.329368:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788622993.329378:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858355072 00010000:00010000:1.0:1788622993.329381:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622993.329391:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858355072 00010000:00010000:1.0:1788622993.329393:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788622993.329399:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.329409:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.329430:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788622993.329433:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788622993.329439:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788622993.329446:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d6fe2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788622993.329464:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 128 00000100:00100000:0.0:1788622993.329476:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10533:x1875506858355072:12345-192.168.204.19@tcp:58:lfs.0 00000040:00080000:0.0:1788622993.329860:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788622993.329968:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10533:x1875506858355072:12345-192.168.204.19@tcp:58:lfs.0 Request processed in 493us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622993.329977:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 128 00010000:00010000:2.0:1788622993.332911:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622993.332920:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788622993.332923:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622993.379443:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622993.379710:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858355200 00000100:00100000:3.0:1788622993.379778:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858355200 00000100:00100000:3.0:1788622993.379847:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 129 00000100:00100000:3.0:1788622993.379859:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:10536:x1875506858355200:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788622993.379892:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622993.379919:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6fe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e940 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380015:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380033:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380047:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380064:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380072:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380078:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380366:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380380:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380390:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380444:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.380462:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 21 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788622993.380480:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07708000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866754432:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788622993.380602:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788622993.389927:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.390034:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858355456 00000100:00100000:2.0:1788622993.390046:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858355456 00000100:00100000:2.0:1788622993.390131:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:2.0:1788622993.390145:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:5586:x1875506858355456:12345-192.168.204.19@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788622993.390472:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:5586:x1875506858355456:12345-192.168.204.19@tcp:35:ldlm_bl.0 Request processed in 330us (556us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788622993.390500:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:3.0:1788622993.390643:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07708000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866754432:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788622993.390696:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788622993.395137:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622993.395245:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858355584 00000100:00100000:2.0:1788622993.395258:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858355584 00010000:00010000:2.0:1788622993.395320:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 23 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622993.395374:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 58 00000100:00100000:2.0:1788622993.395387:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:2348:x1875506858355584:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622993.395408:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622993.395416:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 23 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.395432:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 23 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.395460:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d6f09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e901 expref: 23 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.395482:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622993.395489:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.395501:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.395511:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622993.395574:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622993.395645:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:2348:x1875506858355584:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 262us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622993.395653:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 58 00010000:00010000:3.0:1788622993.396181:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396193:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622993.396309:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788622993.396316:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788622993.396344:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396361:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396373:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396394:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396401:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396407:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622993.396413:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396423:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396438:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788622993.396441:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622993.396446:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396453:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d6ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396470:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396477:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396483:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396489:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788622993.396499:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396506:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396514:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff997e11ed0400) 00010000:00010000:3.0:1788622993.396517:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788622993.396520:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396526:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d6ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396572:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d6fe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e940 expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396588:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e940 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622993.396596:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622993.396599:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788622993.396602:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734a00, rc 0) 00000100:00100000:3.0:1788622993.396666:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10536:x1875506858355200:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 16807us (17236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622993.396674:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 129 00000040:00080000:1.0:1788622994.348318:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788622994.348330:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788622994.348375:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788622994.348382:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788622994.348556:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866754560:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788622994.348692:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788622994.349182:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788622994.353471:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866754560:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788622994.364671:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622994.365348:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858355712 00000100:00100000:1.0:1788622994.365365:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858355712 00000100:00100000:1.0:1788622994.365503:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 130 00000100:00100000:1.0:1788622994.365517:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10548:x1875506858355712:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788622994.365569:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788622994.365726:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10548:x1875506858355712:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 211us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788622994.365734:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 130 00000100:00080000:0.0:1788622994.370876:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788622994.381651:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622994.383434:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858355968 00000100:00100000:2.0:1788622994.383451:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858355968 00000100:00100000:2.0:1788622994.383537:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 131 00000100:00100000:2.0:1788622994.383549:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:10548:x1875506858355968:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788622994.383576:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788622994.383606:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7005 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e947 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.383760:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d700c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.383852:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.383881:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788622994.383904:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788622994.384238:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7005 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e947 expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.384269:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d700c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e947 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.384301:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622994.384305:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788622994.384309:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788622994.384465:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:10548:x1875506858355968:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 916us (2825us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788622994.384475:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 131 00000100:00100000:2.0:1788622994.395704:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622994.397680:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858356096 00000100:00100000:3.0:1788622994.397715:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858356096 00000100:00100000:2.0:1788622994.398206:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:2.0:1788622994.398223:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:2350:x1875506858356096:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788622994.398244:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788622994.398273:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d700c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e947 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.398296:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622994.398302:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788622994.398370:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:2350:x1875506858356096:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 153us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622994.398378:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:0.0:1788622994.400239:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622994.401139:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858356352 00000100:00100000:2.0:1788622994.401157:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858356352 00000100:00100000:2.0:1788622994.401238:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 132 00000100:00100000:2.0:1788622994.401249:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:10548:x1875506858356352:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788622994.401344:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401384:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401397:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401585:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401593:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401600:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401605:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622994.401610:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401616:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401904:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622994.401908:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788622994.401912:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.401919:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d701a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622994.403276:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:10548:x1875506858356352:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 2017us (3037us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788622994.403305:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 132 00000040:00080000:3.0:1788622994.403460:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788622994.403470:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788622994.404015:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788622994.404029:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788622994.413366:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622994.413473:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858356608 00000100:00100000:2.0:1788622994.413487:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858356608 00000100:00100000:2.0:1788622994.413778:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:2.0:1788622994.413795:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:10548:x1875506858356608:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788622994.414117:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10548:x1875506858356608:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 327us (760us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788622994.416002:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 34 00000040:00080000:0.0:1788622994.456476:0:12015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788622994.456489:0:12015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788622994.456544:0:12015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788622994.456552:0:12015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788622994.662142:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622994.662237:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858356864 00000100:00100000:3.0:1788622994.662250:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858356864 00000100:00100000:3.0:1788622994.662326:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 133 00000100:00100000:3.0:1788622994.662337:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:10561:x1875506858356864:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788622994.662370:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622994.662398:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d7021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e94e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.662532:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d7028 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.662550:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d7028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.662563:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d7028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788622994.662576:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788622994.662948:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735600/0xef842f43731d7021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e94e expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.662979:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d7028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e94e expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.662988:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788622994.662999:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788622994.663003:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734000, rc 0) 00000100:00100000:3.0:1788622994.663079:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10561:x1875506858356864:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 743us (949us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788622994.663087:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 133 00000100:00100000:3.0:1788622994.668407:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622994.670894:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858356992 00000100:00100000:2.0:1788622994.670915:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858356992 00000100:00100000:2.0:1788622994.671061:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 134 00000100:00100000:2.0:1788622994.671075:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10561:x1875506858356992:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:2.0:1788622994.671304:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671329:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671346:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671385:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671391:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671399:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671417:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788622994.671423:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671431:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671447:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:2.0:1788622994.671450:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788622994.671456:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788622994.671463:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788622994.671571:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:10561:x1875506858356992:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 498us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622994.671581:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 134 00000100:00100000:3.0:1788622994.773549:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622994.773602:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357120 00000100:00100000:3.0:1788622994.773615:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357120 00000100:00100000:3.0:1788622994.773702:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:3.0:1788622994.773716:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858357120:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:3.0:1788622994.773771:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788622994.773799:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0fa631/0xef842f43731d703d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e955 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788622994.773837:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c3890, atime: 0x6a9c3890, ctime: 0x6a9c3890, blocks: 0xb 00010000:00010000:3.0:1788622994.773867:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1788622994.773872:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788622994.773884:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0fa631/0xef842f43731d703d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e955 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.773909:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea0fa631/0xef842f43731d703d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e955 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788622994.773924:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735600, rc 0) 00000100:00100000:3.0:1788622994.774010:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858357120:12345-192.168.204.19@tcp:101:cat.0 Request processed in 297us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622994.774032:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00080000:3.0:1788622994.774061:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788622994.781420:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788622994.787115:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357248 00000100:00100000:3.0:1788622994.787135:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357248 00002000:00100000:3.0:1788622994.787215:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff997e3750ea00 x1875506858357248/t0(0) o3->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:70/0 lens 488/0 e 0 to 0 dl 1788623005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622994.787228:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3750ea00 with x1875506858357248 ext(0->4095) 00002000:00010000:3.0:1788622994.787235:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e3750ea00 00000100:00100000:3.0:1788622994.787279:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:3.0:1788622994.787292:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858357248:12345-192.168.204.19@tcp:3:cat.0 00000100:00100000:3.0:1788622994.787607:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858357248:12345-192.168.204.19@tcp:3:cat.0 Request processed in 316us (6199us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788622994.787617:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 3 00002000:00100000:3.0:1788622994.787625:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff997e3750ea00 x1875506858357248/t0(0) o3->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:70/0 lens 488/4536 e 0 to 0 dl 1788623005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788622994.787635:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3750ea00 with x1875506858357248 ext(0->4095) 00002000:00010000:3.0:1788622994.787640:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e3750ea00 00010000:00010000:1.0:1788622995.372710:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788622996.013878:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788622996.013913:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866754688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788622996.014014:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622996.015494:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866754688 00000100:00100000:0.0:1788622996.015509:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866754688 00000100:00100000:0.0:1788622996.015606:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788622996.015619:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875506866754688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788622996.015670:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622996.015785:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875506866754688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622996.015792:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788622996.015876:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788622996.015956:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866754688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788622996.398900:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622996.712162:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622996.713818:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357376 00000100:00100000:2.0:1788622996.713836:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357376 00000100:00100000:2.0:1788622996.713910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 292 00000100:00100000:2.0:1788622996.713932:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858357376:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788622996.714024:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858357376:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 95us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622996.714032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 292 00000100:00100000:2.0:1788622996.727608:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622996.727970:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622996.728026:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622996.728056:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788622996.728107:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357760 00000100:00100000:0.0:1788622996.728117:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357760 00000100:00100000:0.0:1788622996.728187:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357632 00000100:00100000:0.0:1788622996.728190:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357632 00000100:00100000:0.0:1788622996.728218:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:0.0:1788622996.728227:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858357760:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622996.728301:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858357760:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 76us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622996.728310:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:0.0:1788622996.728341:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:0.0:1788622996.728349:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858357632:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788622996.728372:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858357632:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622996.728389:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00080000:0.0:1788622996.728405:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788622996.728409:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788622996.734145:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357504 00000100:00100000:3.0:1788622996.734165:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357504 00000100:00100000:3.0:1788622996.734255:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858357888 00000100:00100000:3.0:1788622996.734259:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858357888 00000100:00100000:3.0:1788622996.734299:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 140 00000100:00100000:3.0:1788622996.734310:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:2349:x1875506858357504:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622996.734403:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:2349:x1875506858357504:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 95us (6809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622996.734429:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 140 00000100:00100000:3.0:1788622996.734448:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 141 00000100:00100000:3.0:1788622996.734455:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858357888:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788622996.734478:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858357888:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 24us (6422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788622996.734484:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 141 00000100:00080000:1.0:1788622996.735438:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788622997.137416:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1788622997.424545:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788622997.548961:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866754816:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549065:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622997.549125:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866755328:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549157:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622997.549190:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788622997.549196:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866754944:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549218:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622997.549236:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866755456:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549262:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622997.549296:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866755200:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549323:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622997.549344:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788622997.549349:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866755072:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549371:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788622997.549434:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866754816 00000100:00100000:2.0:1788622997.549445:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866754816 00000100:00100000:2.0:1788622997.549507:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788622997.549518:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866754816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549582:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866754816:12345-0@lo:400:kworker.0 Request processed in 65us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622997.549590:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788622997.549628:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755328 00000100:00100000:2.0:1788622997.549632:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755328 00000100:00100000:2.0:1788622997.549696:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866754944 00000100:00100000:2.0:1788622997.549700:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866754944 00000100:00100000:2.0:1788622997.549712:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755072 00000100:00100000:2.0:1788622997.549714:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755072 00000100:00100000:2.0:1788622997.549729:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788622997.549735:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866755328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.549946:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866755328:12345-0@lo:400:kworker.0 Request processed in 210us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622997.549954:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788622997.549968:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788622997.549974:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866754944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550000:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866754944:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622997.550007:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788622997.550018:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788622997.550024:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866755072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550053:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866755072:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622997.550059:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788622997.550082:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755456 00000100:00100000:2.0:1788622997.550086:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755456 00000100:00100000:2.0:1788622997.550115:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755200 00000100:00100000:2.0:1788622997.550117:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755200 00000100:00100000:2.0:1788622997.550136:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788622997.550142:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866755456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550173:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866755456:12345-0@lo:400:kworker.0 Request processed in 32us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622997.550190:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788622997.550202:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788622997.550208:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875506866755200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550239:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875506866755200:12345-0@lo:400:kworker.0 Request processed in 31us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622997.550244:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788622997.550298:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866754944:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550310:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788622997.550316:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e2eec9500, transno 4294967304 00000100:00100000:2.0:1788622997.550328:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866755456:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550338:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866754816:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550348:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866755328:0@lo:400:kworker.0 00000100:00080000:2.0:1788622997.550379:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788622997.550385:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788622997.550405:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866755072:0@lo:400:kworker.0 00000100:00100000:2.0:1788622997.550417:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866755200:0@lo:400:kworker.0 00000100:00100000:1.0:1788622997.551096:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866755584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788622997.551146:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788622997.552841:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755584 00000100:00100000:0.0:1788622997.552860:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755584 00000100:00100000:0.0:1788622997.552947:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788622997.552959:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866755584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788622997.553005:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788622997.553096:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866755584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788622997.553104:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788622997.553167:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866755584:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788622998.091088:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000001:00080000:1.0:1788622998.091107:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1788622998.091121:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e3ccc4480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788622998.091128:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e06502200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e3ccc4c00 00000020:00080000:1.0:1788622998.091131:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e06502e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997e2f3eec00 00000020:00080000:1.0:1788622998.091153:0:5831:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788622998.091170:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788622998.091208:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788622998.091508:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788622998.444500:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788622998.673414:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788622998.673437:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788622998.673735:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:1.0:1788622999.467965:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788622999.991652:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788622999.991796:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358016 00000100:00100000:2.0:1788622999.991814:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358016 00000100:00100000:2.0:1788622999.991937:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 135 00000100:00100000:2.0:1788622999.991958:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10222:x1875506858358016:12345-192.168.204.19@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788622999.992075:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10222:x1875506858358016:12345-192.168.204.19@tcp:60:lhsmtool_posix.0 Request processed in 128us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788622999.992306:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 135 00000100:00080000:1.0:1788622999.992406:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788622999.994786:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788622999.995045:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358272 00000100:00100000:1.0:1788622999.995054:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358272 00000100:00100000:1.0:1788622999.995175:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:1.0:1788622999.995187:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:10222:x1875506858358272:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788622999.995534:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:10222:x1875506858358272:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 349us (803us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788622999.995542:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:3.0:1788623000.325412:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623000.326275:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358400 00000100:00100000:2.0:1788623000.326289:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358400 00000100:00100000:2.0:1788623000.326384:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 136 00000100:00100000:2.0:1788623000.326401:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:11013:x1875506858358400:12345-192.168.204.19@tcp:101:lsof.0 00010000:00010000:2.0:1788623000.326421:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623000.326442:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e95c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623000.326506:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623000.326520:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623000.326533:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623000.326581:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788623000.326585:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788623000.326633:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623000.326657:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623000.326678:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623000.326709:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:2.0:1788623000.326712:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788623000.326717:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bada00, rc 0) 00000100:00100000:2.0:1788623000.326837:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:11013:x1875506858358400:12345-192.168.204.19@tcp:101:lsof.0 Request processed in 443us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623000.326856:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 136 00000100:00080000:1.0:1788623000.327519:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788623000.492009:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788623000.556105:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788623000.556119:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788623000.556459:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788623000.556468:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788623001.131989:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3750e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866755712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788623001.132064:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623001.132188:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755712 00000100:00100000:0.0:1788623001.132197:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755712 00000100:00100000:0.0:1788623001.132260:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788623001.132271:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866755712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788623001.132330:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623001.132390:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866755712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623001.132397:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788623001.132464:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788623001.132608:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788623001.132614:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e41d28700, transno 4294967310 00000004:00080000:2.0:1788623001.132628:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788623001.132656:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3750e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866755712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788623001.517577:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623001.816970:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623001.817020:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623001.817059:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623001.817093:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623001.817094:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358528 00000100:00100000:2.0:1788623001.817107:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358528 00000100:00100000:2.0:1788623001.817168:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 294 00000100:00100000:2.0:1788623001.817179:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2351:x1875506858358528:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623001.817202:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623001.817235:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359040 00000100:00100000:0.0:1788623001.817240:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359040 00000100:00100000:2.0:1788623001.817263:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2351:x1875506858358528:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623001.817271:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 294 00000100:00100000:2.0:1788623001.817318:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358784 00000100:00100000:2.0:1788623001.817322:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358784 00000100:00100000:2.0:1788623001.817357:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358912 00000100:00100000:2.0:1788623001.817361:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358912 00000100:00100000:0.0:1788623001.817387:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858358656 00000100:00100000:2.0:1788623001.817393:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:0.0:1788623001.817394:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858358656 00000100:00100000:2.0:1788623001.817420:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858358784:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623001.817430:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 145 00000100:00100000:0.0:1788623001.817441:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2351:x1875506858359040:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623001.817455:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858358784:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 38us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623001.817465:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:2.0:1788623001.817480:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:0.0:1788623001.817485:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2351:x1875506858359040:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 44us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623001.817493:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858358912:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623001.817499:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 145 00000100:00100000:0.0:1788623001.817519:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 146 00000100:00100000:2.0:1788623001.817527:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858358912:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 37us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623001.817531:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2351:x1875506858358656:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623001.817540:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00080000:2.0:1788623001.817561:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788623001.817566:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788623001.817568:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788623001.817573:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2351:x1875506858358656:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 45us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623001.817583:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 146 00010000:00010000:1.0:1788623002.545564:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623002.668288:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866756096:0@lo:400:kworker.0 00000100:00100000:2.0:1788623002.668288:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866756224:0@lo:400:kworker.0 00000100:00100000:0.0:1788623002.668364:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866755840:0@lo:400:kworker.0 00000100:00100000:1.0:1788623002.669226:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866755968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788623002.672566:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623002.672682:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756224 00000100:00100000:2.0:1788623002.672691:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756224 00000100:00100000:2.0:1788623002.673018:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788623002.673046:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866756224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623002.673109:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866756224:12345-0@lo:400:kworker.0 Request processed in 81us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623002.673117:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788623002.673139:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788623002.673176:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866756224:0@lo:400:kworker.0 00000100:00100000:3.0:1788623002.676569:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623002.676583:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623002.676672:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866756352:0@lo:400:kworker.0 00000100:00100000:0.0:1788623002.676713:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623002.677030:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623002.677146:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755840 00000100:00100000:0.0:1788623002.677155:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755840 00000100:00100000:1.0:1788623002.677237:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866756480:0@lo:400:kworker.0 00000100:00100000:1.0:1788623002.677303:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756352 00000100:00100000:1.0:1788623002.677307:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756352 00000100:00100000:1.0:1788623002.677343:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788623002.677352:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866756352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623002.677409:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866756352:12345-0@lo:400:kworker.0 Request processed in 57us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623002.677415:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788623002.677444:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866755968 00000100:00100000:1.0:1788623002.677448:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866755968 00000100:00100000:1.0:1788623002.677497:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788623002.677504:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866755968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788623002.677537:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623002.677578:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866755968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623002.677584:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788623002.677794:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866756608:0@lo:400:kworker.0 00000100:00100000:1.0:1788623002.677839:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623002.677846:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623002.677886:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756608 00000100:00100000:3.0:1788623002.677890:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756608 00000100:00100000:3.0:1788623002.677913:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788623002.677919:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866756608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623002.677953:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866756608:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623002.677979:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788623002.678022:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866756608:0@lo:400:kworker.0 00000100:00080000:3.0:1788623002.678060:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788623002.678201:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788623002.678211:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866755840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623002.678247:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866755840:12345-0@lo:400:kworker.0 Request processed in 40us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623002.678254:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788623002.678290:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d07709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866755840:0@lo:400:kworker.0 00000100:00100000:0.0:1788623002.678305:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866756352:0@lo:400:kworker.0 00000100:00100000:1.0:1788623002.685492:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866755968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788623002.687048:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756096 00000100:00100000:2.0:1788623002.687065:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756096 00000100:00100000:0.0:1788623002.687202:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756480 00000100:00100000:0.0:1788623002.687207:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756480 00000100:00100000:2.0:1788623002.687239:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788623002.687253:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866756096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788623002.687296:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788623002.687356:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866756096:12345-0@lo:400:kworker.0 Request processed in 107us (10798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623002.687364:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788623002.687382:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788623002.687388:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866756480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623002.687419:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866756480:12345-0@lo:400:kworker.0 Request processed in 33us (9581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623002.687424:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788623002.687520:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866756096:0@lo:400:kworker.0 00000100:00100000:1.0:1788623002.687556:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866756480:0@lo:400:kworker.0 00000001:00080000:1.0:1788623003.234619:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788623003.234638:0:5831:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788623003.234709:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788623003.234720:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788623003.572709:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788623003.956904:0:12217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:43:23 (1788623003) 00010000:00010000:1.0:1788623004.589269:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623005.612503:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623005.892310:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623005.892416:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359296 00000100:00100000:3.0:1788623005.892425:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359296 00000100:00100000:3.0:1788623005.892499:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 137 00000100:00100000:3.0:1788623005.892517:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:11278:x1875506858359296:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788623005.892538:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623005.892557:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d7052 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e963 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.892623:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.892638:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.892650:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.892663:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.892670:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.892677:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893093:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7067 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893103:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7067 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893110:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7067 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623005.893120:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788623005.893255:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893263:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893269:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893274:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623005.893279:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893287:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893299:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff997e07097900) 00010000:00010000:3.0:1788623005.893301:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623005.893305:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893321:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7059 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893333:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893339:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893345:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893350:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623005.893353:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893359:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893365:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff997e11ed0400) 00010000:00010000:3.0:1788623005.893368:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623005.893370:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893375:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7060 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893966:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d7052 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e963 expref: 16 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.893984:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7067 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e963 expref: 15 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623005.894000:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:3.0:1788623005.894002:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623005.894004:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734200, rc 0) 00000100:00100000:3.0:1788623005.894063:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:11278:x1875506858359296:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 1555us (1765us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788623005.894072:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 137 00000100:00080000:1.0:1788623005.895267:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788623005.898632:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623005.899230:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359424 00000100:00100000:0.0:1788623005.899243:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359424 00000100:00100000:0.0:1788623005.899322:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:0.0:1788623005.899332:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:2350:x1875506858359424:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623005.899348:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623005.899377:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7067 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e963 expref: 15 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623005.899401:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:0.0:1788623005.899406:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623005.899468:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2350:x1875506858359424:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 138us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623005.899492:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:3.0:1788623005.900105:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623005.900171:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359552 00000100:00100000:1.0:1788623005.900185:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359552 00000100:00100000:1.0:1788623005.900227:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 138 00000100:00100000:1.0:1788623005.900236:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11278:x1875506858359552:12345-192.168.204.19@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788623005.900323:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11278:x1875506858359552:12345-192.168.204.19@tcp:59:lhsmtool_posix.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623005.900330:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 138 00000100:00100000:1.0:1788623006.257811:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866756736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788623006.257892:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623006.261883:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756736 00000100:00100000:0.0:1788623006.261900:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756736 00000100:00100000:0.0:1788623006.261968:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788623006.261981:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866756736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788623006.262020:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623006.262116:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866756736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623006.262123:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788623006.262146:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788623006.262195:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866756736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788623006.648933:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788623006.703980:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788623006.703994:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788623006.704035:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788623006.704043:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788623006.940424:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623006.940468:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623006.940496:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623006.940516:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623006.940558:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623006.940587:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359936 00000100:00100000:2.0:1788623006.940597:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359936 00000100:00100000:2.0:1788623006.940655:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360064 00000100:00100000:2.0:1788623006.940658:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360064 00000100:00100000:2.0:1788623006.940688:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:2.0:1788623006.940698:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858359936:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623006.940882:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359680 00000100:00100000:3.0:1788623006.940886:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359680 00000100:00100000:3.0:1788623006.940916:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 296 00000100:00100000:3.0:1788623006.940923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858359680:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623006.945686:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858359936:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 4969us (5195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623006.945735:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:2.0:1788623006.945791:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:2.0:1788623006.945817:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858360064:12345-192.168.204.19@tcp:400:kworker.0 00000100:00080000:1.0:1788623006.947928:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788623006.947939:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788623006.947964:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360192 00000100:00100000:1.0:1788623006.947977:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360192 00000100:00100000:1.0:1788623006.948065:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858359808 00000100:00100000:1.0:1788623006.948068:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858359808 00000100:00100000:1.0:1788623006.948095:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 150 00000100:00100000:1.0:1788623006.948105:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2348:x1875506858360192:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623006.948324:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858359680:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 7399us (7907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623006.948336:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 296 00000100:00100000:2.0:1788623006.948608:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858360064:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 2805us (8046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623006.948617:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:2.0:1788623006.948834:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 151 00000100:00100000:2.0:1788623006.948843:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e37398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858359808:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623006.948890:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e37398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858359808:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 49us (8373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623006.948897:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 151 00000100:00100000:1.0:1788623006.951220:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2348:x1875506858360192:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 3094us (10700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623006.951237:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 150 00000100:00080000:1.0:1788623006.951288:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788623007.660957:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623007.788193:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788623007.788224:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866756864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623007.788312:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623007.788560:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756864 00000100:00100000:1.0:1788623007.788570:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756864 00000100:00100000:1.0:1788623007.788642:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788623007.788652:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866756864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788623007.788694:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623007.788777:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866756864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623007.788800:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788623007.788872:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866756864:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788623007.789110:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788623007.789370:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866757120:0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.789409:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623007.789435:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788623007.789449:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866757248:0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.789474:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623007.789505:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866757120 00000100:00100000:3.0:1788623007.789510:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866757120 00000100:00100000:3.0:1788623007.789539:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866757248 00000100:00100000:3.0:1788623007.789542:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866757248 00000100:00100000:3.0:1788623007.789584:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788623007.789592:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866757120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.789630:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866757120:12345-0@lo:400:kworker.0 Request processed in 39us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623007.789637:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788623007.789650:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788623007.789657:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866757248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.789683:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866757248:12345-0@lo:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623007.789688:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1788623007.789714:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788623007.789733:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866757248:0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.789780:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866757120:0@lo:400:kworker.0 00000100:00100000:2.0:1788623007.790075:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866756992:0@lo:400:kworker.0 00000100:00100000:2.0:1788623007.790109:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623007.790147:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866757504:0@lo:400:kworker.0 00000100:00100000:2.0:1788623007.790171:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623007.790189:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788623007.790195:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866757376:0@lo:400:kworker.0 00000100:00100000:2.0:1788623007.790220:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623007.790290:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866756992 00000100:00100000:3.0:1788623007.790295:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866756992 00000100:00100000:3.0:1788623007.790333:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788623007.790341:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866756992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.790379:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3281:x1875506866756992:12345-0@lo:400:kworker.0 Request processed in 39us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623007.790386:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788623007.790421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866757504 00000100:00100000:3.0:1788623007.790425:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866757504 00000100:00100000:3.0:1788623007.790453:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788623007.790458:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866757504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.790483:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866757504:12345-0@lo:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623007.790489:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788623007.790502:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788623007.790518:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866756992:0@lo:400:kworker.0 00000100:00100000:3.0:1788623007.790529:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866757504:0@lo:400:kworker.0 00000100:00100000:1.0:1788623007.791060:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866757376 00000100:00100000:1.0:1788623007.791065:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866757376 00000100:00100000:1.0:1788623007.791104:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788623007.791112:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866757376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623007.791245:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866757376:12345-0@lo:400:kworker.0 Request processed in 134us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623007.791252:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788623007.795961:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866757376:0@lo:400:kworker.0 00000100:00100000:3.0:1788623008.184906:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623008.185023:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360320 00000100:00100000:0.0:1788623008.185034:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360320 00000100:00100000:0.0:1788623008.185108:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 139 00000100:00100000:0.0:1788623008.185118:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11320:x1875506858360320:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623008.185139:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623008.185162:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e96a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185229:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185244:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185258:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185289:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185297:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185304:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185610:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185618:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185624:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185629:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623008.185633:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185640:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185651:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:0.0:1788623008.185654:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623008.185658:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185664:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d707c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185683:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185688:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185703:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185708:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623008.185710:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185715:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185723:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff997e05312400) 00010000:00010000:0.0:1788623008.185725:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623008.185728:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185734:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d7083 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185798:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7075 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e96a expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185809:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:0.0:1788623008.185811:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623008.185822:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e96a expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.185832:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9c00, rc 0) 00000100:00100000:0.0:1788623008.185896:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11320:x1875506858360320:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 779us (1003us total) trans 0 rc 301/301 00000100:00100000:0.0:1788623008.185904:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 139 00000100:00080000:3.0:1788623008.186402:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788623008.195484:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623008.195668:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360576 00000100:00100000:0.0:1788623008.195679:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360576 00000100:00100000:0.0:1788623008.195779:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 140 00000100:00100000:0.0:1788623008.195791:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11320:x1875506858360576:12345-192.168.204.19@tcp:36:lfs.0 00010000:00010000:0.0:1788623008.195862:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623008.195893:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d69f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7a3 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.195913:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:0.0:1788623008.195919:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788623008.196144:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.196159:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.196169:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.196206:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.196232:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 5 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623008.196248:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866757632:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623008.196347:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788623008.202239:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623008.202519:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866757632:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623008.202561:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.203049:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360704 00000100:00100000:3.0:1788623008.203058:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360704 00010000:00010000:3.0:1788623008.203120:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 6 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.203162:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:3.0:1788623008.203172:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2348:x1875506858360704:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623008.203187:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623008.203194:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 6 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.203209:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 6 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.203232:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d704b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e95c expref: 6 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.203255:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:3.0:1788623008.203260:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.203269:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.203277:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.203316:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623008.203369:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858360704:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 198us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.203376:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00080000:1.0:1788623008.203503:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788623008.203516:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.203523:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.203557:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.203567:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.203575:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623008.204604:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788623008.204618:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.204628:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.204633:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.204639:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623008.204643:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.204651:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.204664:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:1.0:1788623008.204667:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623008.204671:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.204678:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d708a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623008.204709:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7fbed8e reply state 0000000065ff3dc9 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623008.204718:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788623008.205519:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:11320:x1875506858360576:12345-192.168.204.19@tcp:36:lfs.0 Request processed in 9022us (9342us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788623008.205621:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 140 00010000:00010000:3.0:1788623008.212862:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.212883:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.212891:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.212897:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623008.212902:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.212910:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.212951:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff997e11991600) 00010000:00010000:3.0:1788623008.212954:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623008.212959:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.212967:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7091 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.293258:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623008.293358:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360832 00000100:00100000:1.0:1788623008.293369:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360832 00000100:00100000:1.0:1788623008.293439:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 141 00000100:00100000:1.0:1788623008.293450:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11328:x1875506858360832:12345-192.168.204.19@tcp:101:lctl.0 00010000:00010000:1.0:1788623008.293477:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623008.293504:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e971 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.293584:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da600/0xef842f43731d709f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.293598:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da600/0xef842f43731d709f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.293610:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da600/0xef842f43731d709f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623008.293649:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788623008.293654:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623008.293677:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da600/0xef842f43731d709f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.293714:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e971 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.293736:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da600/0xef842f43731d709f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e971 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.293788:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:1.0:1788623008.293791:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788623008.293795:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da600, rc 0) 00000100:00100000:1.0:1788623008.293858:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:11328:x1875506858360832:12345-192.168.204.19@tcp:101:lctl.0 Request processed in 410us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623008.293865:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 141 00000100:00100000:3.0:1788623008.398239:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.398371:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858360960 00000100:00100000:3.0:1788623008.398382:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858360960 00000100:00100000:3.0:1788623008.398455:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 142 00000100:00100000:3.0:1788623008.398466:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+15:11334:x1875506858360960:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:3.0:1788623008.398489:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623008.398514:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d70a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e978 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.398590:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.398607:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.398618:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.398634:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.398663:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.398670:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788623008.399051:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00010000:00010000:3.0:1788623008.399255:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d70bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399266:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d70bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399274:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d70bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623008.399308:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788623008.399312:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788623008.399334:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d70bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399347:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399354:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399361:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399366:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623008.399370:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399462:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399479:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:3.0:1788623008.399482:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623008.399487:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399493:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d70ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399507:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399513:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399519:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399524:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623008.399527:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399533:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399540:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff997e11ed0400) 00010000:00010000:3.0:1788623008.399543:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623008.399545:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399561:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d70b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399602:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d70a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e978 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399616:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d70bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e978 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.399623:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623008.399625:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788623008.399628:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735400, rc 0) 00000100:00100000:3.0:1788623008.399714:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11334:x1875506858360960:12345-192.168.204.19@tcp:101:bash.0 Request processed in 1249us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.399722:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 142 00000100:00100000:1.0:1788623008.407729:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.407841:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858361216 00000100:00100000:2.0:1788623008.407852:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858361216 00000100:00100000:2.0:1788623008.407907:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 143 00000100:00100000:2.0:1788623008.407917:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:11334:x1875506858361216:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788623008.407960:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.407983:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d70c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e97f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.408273:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.408293:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.408308:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.408325:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.408333:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.408340:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788623008.409124:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788623008.409431:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409445:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409455:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409510:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409518:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409525:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409531:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623008.409536:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409544:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409557:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623008.409560:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623008.409566:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409572:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788623008.409584:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078b1ec88 reply state 00000000c5575b1f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623008.409594:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788623008.409631:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d70c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409661:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.409669:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:2.0:1788623008.409672:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623008.409674:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788623008.409830:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:11334:x1875506858361216:12345-192.168.204.19@tcp:101:bash.0 Request processed in 1914us (2111us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788623008.409839:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 143 00010000:00010000:1.0:1788623008.412784:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.412806:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.412815:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.412821:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623008.412826:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.412835:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.412854:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e07097d00) 00010000:00010000:1.0:1788623008.412857:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623008.412862:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.412869:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d70d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623008.418923:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.419363:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858361344 00000100:00100000:2.0:1788623008.419376:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858361344 00000100:00100000:2.0:1788623008.419463:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:2.0:1788623008.419474:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2348:x1875506858361344:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788623008.419492:0:6657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.419513:0:6657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e986 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788623008.419543:0:6657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788623008.419562:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1788623008.419566:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623008.419577:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 6 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.419598:0:6657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 6 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.419627:0:6657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623008.419683:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858361344:12345-192.168.204.19@tcp:101:bash.0 Request processed in 212us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623008.419702:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00080000:1.0:1788623008.420056:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788623008.423227:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.423304:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858361472 00000100:00100000:2.0:1788623008.423315:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858361472 00000100:00100000:2.0:1788623008.423384:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:2.0:1788623008.423405:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:11334:x1875506858361472:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788623008.423426:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.423445:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e98d expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.423484:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.423494:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623008.423498:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623008.423504:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.423539:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.423553:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623008.423579:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6656:1875506866757760:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623008.423675:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f163240 going to sleep for 11 seconds 00000100:00100000:1.0:1788623008.426784:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6656:1875506866757760:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623008.426840:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.426864:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bada00, rc 0) 00000100:00100000:1.0:1788623008.426935:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:11334:x1875506858361472:12345-192.168.204.19@tcp:101:bash.0 Request processed in 3524us (3711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623008.426945:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:3.0:1788623008.428307:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.429004:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858361600 00000100:00100000:2.0:1788623008.429014:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858361600 00010000:00010000:2.0:1788623008.429053:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623008.429098:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:2.0:1788623008.429108:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858361600:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788623008.429124:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623008.429147:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.429161:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.429184:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d70e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e986 expref: 7 pid: 6657 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.429201:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623008.429206:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623008.429216:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.429249:0:7602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.429290:0:7602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623008.429305:0:7602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7602:1875506866757888:192.168.204.19@tcp:105: 00000100:00100000:2.0:1788623008.429384:0:7602:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f163f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788623008.437898:0:7602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7602:1875506866757888:192.168.204.19@tcp:105: 00010000:00010000:1.0:1788623008.437934:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623008.437989:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858361600:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 8882us (9691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623008.438001:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:1.0:1788623008.439437:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.439672:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858361856 00000100:00100000:3.0:1788623008.439684:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858361856 00000100:00100000:3.0:1788623008.439777:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:3.0:1788623008.439788:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+16:11334:x1875506858361856:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:3.0:1788623008.440166:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:11334:x1875506858361856:12345-192.168.204.19@tcp:35:bash.0 Request processed in 379us (737us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788623008.440174:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:3.0:1788623008.548212:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.548667:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858362112 00000100:00100000:2.0:1788623008.548681:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858362112 00000100:00100000:2.0:1788623008.548793:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 144 00000100:00100000:2.0:1788623008.548804:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:11344:x1875506858362112:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623008.548830:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.548855:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e994 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623008.548954:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788623008.549086:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e994 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.549102:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:2.0:1788623008.549105:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623008.549111:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d70f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e994 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.549149:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad000, rc 0) 00000100:00100000:2.0:1788623008.549218:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11344:x1875506858362112:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 416us (1022us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788623008.549226:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 144 00000100:00100000:2.0:1788623008.556097:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.556281:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858362368 00000100:00100000:3.0:1788623008.556291:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858362368 00000100:00100000:3.0:1788623008.556379:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:3.0:1788623008.556402:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11344:x1875506858362368:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:3.0:1788623008.556660:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:11344:x1875506858362368:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 261us (578us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788623008.556668:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:1.0:1788623008.676207:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.676349:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858362496 00000100:00100000:2.0:1788623008.676361:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858362496 00000100:00100000:2.0:1788623008.676435:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 145 00000100:00100000:2.0:1788623008.676454:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:11350:x1875506858362496:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623008.676482:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.676504:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e99b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.676592:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d7108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.676608:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d7108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.676620:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d7108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623008.676656:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788623008.676660:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788623008.676679:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d7108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.676718:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e99b expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.676790:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d7108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e99b expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.676798:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623008.676801:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788623008.676804:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788623008.677063:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11350:x1875506858362496:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 609us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623008.677070:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 145 00010000:00010000:1.0:1788623008.684074:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623008.689353:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.689567:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858362752 00000100:00100000:2.0:1788623008.689578:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858362752 00000100:00100000:2.0:1788623008.689644:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 146 00000100:00100000:2.0:1788623008.689655:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11350:x1875506858362752:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623008.689678:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.689709:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d710f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9a2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.690028:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.690044:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.690056:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623008.690068:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788623008.690225:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d710f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a2 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.690246:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a2 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.690255:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:2.0:1788623008.690257:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623008.690261:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623008.690453:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:11350:x1875506858362752:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 799us (1112us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788623008.690461:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 146 00000100:00100000:1.0:1788623008.700295:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623008.700351:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.700838:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363136 00000100:00100000:3.0:1788623008.700848:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363136 00000100:00100000:3.0:1788623008.700923:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788623008.700933:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:2351:x1875506858363136:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623008.700950:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623008.700975:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a2 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.701007:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:3.0:1788623008.701012:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623008.701083:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:2351:x1875506858363136:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 151us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.701090:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:2.0:1788623008.701714:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363008 00000100:00100000:2.0:1788623008.701720:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363008 00000100:00100000:2.0:1788623008.701808:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 147 00000100:00100000:2.0:1788623008.701825:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:11350:x1875506858363008:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623008.701848:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.701867:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7124 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.701966:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d712b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.701981:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d712b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.702004:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d712b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623008.702038:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788623008.702180:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a9 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.702199:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d712b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a9 expref: 23 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.702207:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:2.0:1788623008.702210:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788623008.702212:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad400, rc 0) 00000100:00100000:2.0:1788623008.702262:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:11350:x1875506858363008:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 446us (1981us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788623008.702268:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 147 00000100:00100000:1.0:1788623008.710268:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.710359:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363264 00000100:00100000:3.0:1788623008.710369:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363264 00000100:00100000:3.0:1788623008.710436:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:3.0:1788623008.710633:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858363264:12345-192.168.204.19@tcp:1:lfs.0 00010000:00010000:3.0:1788623008.710693:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.710717:0:6657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.712213:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623008.712224:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623008.712231:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.712291:0:6657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.712307:0:6657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 6 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.712323:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e0612ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6657:1875506866758016:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623008.714158:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e036c8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788623008.729833:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.730006:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363392 00000100:00100000:2.0:1788623008.730017:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363392 00002000:00100000:2.0:1788623008.730070:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff997d07708e00 x1875506858363392/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:84/0 lens 504/0 e 0 to 0 dl 1788623019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788623008.730081:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997d07708e00 with x1875506858363392 ext(0->12) 00010000:00010000:2.0:1788623008.730089:0:6662:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 7 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.730106:0:6662:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 7 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788623008.730113:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997d07708e00 00000100:00100000:2.0:1788623008.730150:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:2.0:1788623008.730179:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858363392:12345-192.168.204.19@tcp:4:lfs.0 00000100:00100000:2.0:1788623008.730963:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858363392:12345-192.168.204.19@tcp:4:lfs.0 Request processed in 780us (1148us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788623008.730971:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00002000:00100000:2.0:1788623008.730980:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff997d07708e00 x1875506858363392/t4294967305(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:84/0 lens 504/448 e 0 to 0 dl 1788623019 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788623008.730989:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997d07708e00 with x1875506858363392 ext(0->12) 00010000:00010000:2.0:1788623008.730997:0:6662:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 9 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.731012:0:6662:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 9 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788623008.731019:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997d07708e00 00000100:00100000:3.0:1788623008.731864:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e0612ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6657:1875506866758016:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623008.731891:0:6657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623008.738236:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623008.738408:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363520 00000100:00100000:0.0:1788623008.738419:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363520 00010000:00010000:0.0:1788623008.738460:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 9 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623008.738506:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:0.0:1788623008.738669:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2350:x1875506858363520:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623008.738695:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788623008.738715:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788623008.738719:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788623009 00002000:00010000:0.0:1788623008.738721:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788623009 00002000:00010000:0.0:1788623008.738723:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788623009 00010000:00010000:0.0:1788623008.738730:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 9 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.738780:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 9 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.738837:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021c33821/0xef842f43731d70ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e98d expref: 9 pid: 6656 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.738856:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623008.738860:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623008.738866:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.738875:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.738909:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623008.738971:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2350:x1875506858363520:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 306us (748us total) trans 0 rc 0/0 00010000:00010000:3.0:1788623008.739482:0:6657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739494:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739536:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739557:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739564:0:6657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739571:0:6657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623008.739576:0:6657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739585:0:6657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739599:0:6657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.739608:0:6657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7139 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.739677:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858363264:12345-192.168.204.19@tcp:1:lfs.0 Request processed in 29050us (29422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.739695:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:0.0:1788623008.743210:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:1.0:1788623008.747441:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.747545:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363776 00000100:00100000:3.0:1788623008.747556:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363776 00000100:00100000:3.0:1788623008.747615:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:3.0:1788623008.747633:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:11350:x1875506858363776:12345-192.168.204.19@tcp:35:lfs.0 00000004:00010000:3.0:1788623008.747712:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d712b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a9 expref: 23 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788623008.748258:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788623008.748304:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788623008.749340:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788623008.749433:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.749454:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.749464:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.749503:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.749545:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 27 pid: 5810 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623008.749564:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5812:1875506866758144:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623008.749675:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f163f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623008.756883:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.757105:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858363904 00000100:00100000:3.0:1788623008.757113:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858363904 00010000:00010000:3.0:1788623008.757155:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 28 pid: 5810 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.757200:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 62 00000100:00100000:3.0:1788623008.757210:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eeca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:2348:x1875506858363904:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623008.757225:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623008.757232:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 28 pid: 5810 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.757246:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 28 pid: 5810 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.757271:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:3.0:1788623008.757277:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.757287:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.757296:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.757315:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623008.757519:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eeca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:2348:x1875506858363904:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 300us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.757528:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 62 00010000:00010000:1.0:1788623008.759655:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d70d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e97f expref: 27 pid: 5810 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623008.759695:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5812:1875506866758144:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623008.759722:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.759732:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623008.759738:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788623008.759942:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788623008.760168:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788623008.760288:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2ce680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866758272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788623008.760355:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623008.760411:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623008.761223:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866758272 00000100:00100000:0.0:1788623008.761235:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866758272 00000100:00100000:0.0:1788623008.761299:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788623008.761310:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866758272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788623008.761432:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866758272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623008.761440:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788623008.761491:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2ce680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866758272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788623008.762115:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788623008.762194:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866758400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788623008.762248:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623008.762283:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866758400 00000100:00100000:0.0:1788623008.762289:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866758400 00000100:00100000:0.0:1788623008.762317:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788623008.762325:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866758400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788623008.762467:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1875506866758400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (218us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788623008.762474:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788623008.762494:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788623008.762515:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866758400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788623008.762561:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788623008.762593:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.762603:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.762610:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.762615:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623008.762620:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.762628:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.762643:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:0.0:1788623008.762646:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788623008.762660:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623008.762667:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7140 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788623008.762883:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788623008.763026:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788623008.763038:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332718295043ns, next at 333718293016ns, rc = 0 00000001:00080000:0.0:1788623008.763044:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788623008.763076:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e07097600) 00010000:00010000:0.0:1788623008.763079:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788623008.763086:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d712b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9a9 expref: 31 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623008.763173:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:11350:x1875506858363776:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 15542us (15746us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788623008.763182:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 38 00000020:00080000:0.0:1788623008.763186:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788623008.770996:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.774798:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858364032 00000100:00100000:3.0:1788623008.774829:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858364032 00000100:00100000:3.0:1788623008.774913:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 148 00000100:00100000:3.0:1788623008.774925:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+30:11350:x1875506858364032:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623008.774954:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623008.774982:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9b0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.775051:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9b0 expref: 31 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.775068:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9b0 expref: 31 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.775091:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788623008.775094:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788623008.775097:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735200, rc 0) 00000100:00100000:3.0:1788623008.775167:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:11350:x1875506858364032:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 244us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.775174:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 148 00000100:00100000:2.0:1788623008.782083:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623008.782185:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858364288 00000100:00100000:1.0:1788623008.782194:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858364288 00000100:00100000:1.0:1788623008.782252:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:1.0:1788623008.782262:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:11350:x1875506858364288:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788623008.782528:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11350:x1875506858364288:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 267us (459us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788623008.782536:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:1.0:1788623008.932203:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.932312:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858364544 00000100:00100000:2.0:1788623008.932322:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858364544 00000100:00100000:2.0:1788623008.932390:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 149 00000100:00100000:2.0:1788623008.932402:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11360:x1875506858364544:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623008.932431:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623008.932456:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d714e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623008.932580:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788623008.932730:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d714e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9b7 expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.932786:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:2.0:1788623008.932790:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623008.932795:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d714e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9b7 expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623008.932811:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623008.932912:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:11360:x1875506858364544:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 513us (724us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788623008.932920:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 149 00000100:00100000:2.0:1788623008.936536:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623008.938339:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858364672 00000100:00100000:3.0:1788623008.938355:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858364672 00000100:00100000:3.0:1788623008.938647:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 150 00000100:00100000:3.0:1788623008.938660:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:11360:x1875506858364672:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:3.0:1788623008.939301:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939325:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939343:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939361:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939369:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939375:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939633:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939642:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.939650:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788623008.942800:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943003:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943038:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943046:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943052:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623008.943057:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943065:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943085:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623008.943088:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623008.943094:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943101:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d715c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943118:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943124:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943130:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943135:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623008.943145:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943151:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943160:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11ed0a00) 00010000:00010000:3.0:1788623008.943163:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623008.943166:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943172:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d7163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943190:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943195:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943200:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943204:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623008.943207:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943212:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943219:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788623008.943220:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623008.943230:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623008.943235:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d716a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623008.943346:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:11360:x1875506858364672:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 4682us (6818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623008.943356:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 150 00000100:00100000:1.0:1788623008.946787:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623008.947115:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858364928 00000100:00100000:2.0:1788623008.947126:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858364928 00000100:00100000:2.0:1788623008.947182:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:2.0:1788623008.947192:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+33:11360:x1875506858364928:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:2.0:1788623008.947448:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:11360:x1875506858364928:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 256us (675us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788623008.947457:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:1.0:1788623009.001409:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623009.001799:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858365184 00000100:00100000:2.0:1788623009.001811:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858365184 00000100:00100000:2.0:1788623009.001885:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 151 00000100:00100000:2.0:1788623009.001896:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:11363:x1875506858365184:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623009.001923:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623009.001946:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9be expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002029:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002045:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002058:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002087:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002095:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002102:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002228:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002237:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002244:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623009.002253:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788623009.002368:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002375:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002382:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002389:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623009.002394:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002413:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002427:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623009.002430:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623009.002434:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002440:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002455:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002461:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002466:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002471:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623009.002473:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002479:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.002485:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e07097400) 00010000:00010000:2.0:1788623009.002488:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623009.002490:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.003196:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d717f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.003267:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.003281:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.003289:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788623009.003291:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623009.003295:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bada00, rc 0) 00000100:00100000:2.0:1788623009.003499:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:11363:x1875506858365184:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1603us (2100us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788623009.003517:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 151 00000100:00100000:3.0:1788623009.010391:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623009.010468:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858365312 00000100:00100000:2.0:1788623009.010480:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858365312 00000100:00100000:2.0:1788623009.010552:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 152 00000100:00100000:2.0:1788623009.010563:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:11363:x1875506858365312:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:2.0:1788623009.010640:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010659:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010671:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010730:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010736:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010782:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010788:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623009.010792:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010801:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010824:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788623009.010827:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623009.010832:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.010839:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623009.010926:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:11363:x1875506858365312:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 364us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623009.010934:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 152 00000100:00100000:1.0:1788623009.014388:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623009.014467:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858365568 00000100:00100000:2.0:1788623009.014477:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858365568 00000100:00100000:2.0:1788623009.014547:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:2.0:1788623009.014574:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:11363:x1875506858365568:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:2.0:1788623009.014895:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:11363:x1875506858365568:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 321us (521us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788623009.014902:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:1.0:1788623009.329409:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623009.329555:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858365824 00000100:00100000:3.0:1788623009.329570:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858365824 00000100:00100000:3.0:1788623009.329649:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 153 00000100:00100000:3.0:1788623009.329661:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:11394:x1875506858365824:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:3.0:1788623009.329705:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623009.329733:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d719b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9c5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.329912:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d71a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.329931:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d71a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.329949:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d71a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623009.329961:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788623009.330131:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d719b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9c5 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.330174:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d71a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9c5 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.330183:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788623009.330187:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788623009.330191:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735a00, rc 0) 00000100:00100000:3.0:1788623009.330281:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11394:x1875506858365824:12345-192.168.204.19@tcp:101:cat.0 Request processed in 622us (888us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788623009.330289:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 153 00000100:00100000:3.0:1788623009.338244:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623009.338357:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858365952 00000100:00100000:1.0:1788623009.338370:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858365952 00000100:00100000:1.0:1788623009.338462:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:1.0:1788623009.338474:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:2349:x1875506858365952:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623009.338494:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623009.338529:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d71a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9c5 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.338552:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623009.338558:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623009.338628:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:2349:x1875506858365952:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 157us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623009.338636:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:1.0:1788623009.345703:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623009.345937:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858366208 00000100:00100000:2.0:1788623009.345950:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858366208 00000100:00100000:2.0:1788623009.346021:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:2.0:1788623009.346034:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:11394:x1875506858366208:12345-192.168.204.19@tcp:35:cat.0 00000100:00100000:2.0:1788623009.346360:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11394:x1875506858366208:12345-192.168.204.19@tcp:35:cat.0 Request processed in 329us (670us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788623009.346369:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:2.0:1788623009.440051:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623009.440799:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858366464 00000100:00100000:3.0:1788623009.440814:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858366464 00000100:00100000:3.0:1788623009.440902:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 154 00000100:00100000:3.0:1788623009.440915:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11400:x1875506858366464:12345-192.168.204.19@tcp:101:dd.0 00010000:00010000:3.0:1788623009.440947:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623009.440952:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788623009.441001:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bac200/0xef842f43731d7108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e99b expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.441027:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623009.441034:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788623009.441054:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d71b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9cc expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.441194:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.441224:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.441234:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.441279:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.441296:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 39 pid: 5810 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623009.441313:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef52300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866758528:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623009.441454:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e036c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623009.446130:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef52300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866758528:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788623009.446168:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623009.451502:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623009.452614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858366592 00000100:00100000:0.0:1788623009.452630:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858366592 00010000:00010000:0.0:1788623009.452692:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 40 pid: 5810 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623009.453198:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:0.0:1788623009.453215:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+40:2351:x1875506858366592:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623009.453254:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623009.453264:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 40 pid: 5810 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623009.453280:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 40 pid: 5810 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623009.453309:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9be expref: 40 pid: 5810 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623009.453328:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:0.0:1788623009.453335:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623009.453346:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623009.453356:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623009.453624:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623009.453706:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:2351:x1875506858366592:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 496us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623009.453723:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 63 00010000:00010000:1.0:1788623009.458392:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.458416:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623009.458463:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788623009.458990:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d71b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.459015:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.459047:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623009.459050:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788623009.459055:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734c00, rc 0) 00000100:00100000:1.0:1788623009.459144:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11400:x1875506858366464:12345-192.168.204.19@tcp:101:dd.0 Request processed in 18231us (19104us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788623009.459154:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 154 00000100:00100000:2.0:1788623009.470385:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623009.470678:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858366848 00000100:00100000:3.0:1788623009.470690:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858366848 00000100:00100000:3.0:1788623009.471007:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 155 00000100:00100000:3.0:1788623009.471019:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11400:x1875506858366848:12345-192.168.204.19@tcp:36:dd.0 00010000:00010000:3.0:1788623009.471325:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.471348:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.471361:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788623009.472806:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788623009.472881:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003316d06 reply state 00000000b3d334e5 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623009.472894:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788623009.473031:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+42:11400:x1875506858366848:12345-192.168.204.19@tcp:36:dd.0 Request processed in 2009us (2665us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788623009.473041:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 155 00000020:00080000:3.0:1788623009.473047:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788623009.489158:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.489182:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.489191:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.489197:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623009.489203:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.489213:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.489234:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623009.489237:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623009.489242:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.489249:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d71c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.709085:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623009.856347:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623009.856524:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858366976 00000100:00100000:1.0:1788623009.856540:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858366976 00000100:00100000:1.0:1788623009.856627:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 156 00000100:00100000:1.0:1788623009.856640:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+41:11415:x1875506858366976:12345-192.168.204.19@tcp:101:stat.0 00010000:00010000:1.0:1788623009.856684:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623009.856716:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d71cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9d3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857182:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857202:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857217:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857235:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857242:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857250:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857541:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857556:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 42 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857583:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857631:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 42 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.857650:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 42 pid: 5809 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623009.857677:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e371e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866758656:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623009.858485:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548180 going to sleep for 11 seconds 00000100:00100000:3.0:1788623009.861632:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623009.861773:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858367232 00000100:00100000:2.0:1788623009.861785:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858367232 00000100:00100000:2.0:1788623009.861924:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:2.0:1788623009.861936:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+43:5587:x1875506858367232:12345-192.168.204.19@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788623009.862339:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+44:5587:x1875506858367232:12345-192.168.204.19@tcp:35:ldlm_bl.0 Request processed in 405us (716us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788623009.862348:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:1.0:1788623009.863056:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e371e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866758656:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623009.863094:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623009.866935:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623009.867089:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858367360 00000100:00100000:1.0:1788623009.867102:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858367360 00010000:00010000:1.0:1788623009.867158:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 44 pid: 5809 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623009.867211:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 64 00000100:00100000:1.0:1788623009.867223:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+44:2348:x1875506858367360:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623009.867244:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623009.867252:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 44 pid: 5809 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.867291:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 44 pid: 5809 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.867320:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d71b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9cc expref: 44 pid: 5809 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.867342:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623009.867350:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.867373:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.867383:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.867425:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623009.867500:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+43:2348:x1875506858367360:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 278us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623009.867508:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 64 00010000:00010000:3.0:1788623009.867627:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867637:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623009.867708:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788623009.867715:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788623009.867810:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867836:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867847:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867855:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867862:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867880:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623009.867885:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867906:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867918:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623009.867921:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623009.867925:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867932:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da200/0xef842f43731d71d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867945:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867951:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867957:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867963:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623009.867966:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867972:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.867991:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991e00) 00010000:00010000:3.0:1788623009.867994:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623009.867997:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.868003:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d71da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.868052:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d71cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9d3 expref: 43 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.868068:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9d3 expref: 42 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623009.868076:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788623009.868078:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788623009.868081:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da800, rc 0) 00000100:00100000:3.0:1788623009.868115:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+42:11415:x1875506858366976:12345-192.168.204.19@tcp:101:stat.0 Request processed in 11478us (11781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623009.868124:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 156 00000100:00100000:3.0:1788623009.938093:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623009.938350:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858367616 00000100:00100000:2.0:1788623009.938363:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858367616 00000100:00100000:2.0:1788623009.938472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 157 00000100:00100000:2.0:1788623009.938485:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+42:11421:x1875506858367616:12345-192.168.204.19@tcp:36:truncate.0 00010000:00010000:2.0:1788623009.938593:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623009.938630:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d71e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9d3 expref: 42 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.938653:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788623009.938671:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788623009.939286:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.939305:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623009.939317:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788623009.939393:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788623009.939419:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c201666 reply state 000000007bcc744b transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623009.939429:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788623009.939557:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+44:11421:x1875506858367616:12345-192.168.204.19@tcp:36:truncate.0 Request processed in 1073us (1473us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788623009.939566:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 157 00000020:00080000:2.0:1788623009.939573:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788623009.943267:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.943289:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.943298:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.943330:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623009.943336:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.943345:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.943381:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623009.943385:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623009.943391:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623009.943398:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d71e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623010.109138:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.110347:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858367744 00000100:00100000:0.0:1788623010.110430:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858367744 00000100:00100000:0.0:1788623010.110609:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 158 00000100:00100000:0.0:1788623010.110623:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+43:11435:x1875506858367744:12345-192.168.204.19@tcp:101:stat.0 00010000:00010000:0.0:1788623010.110686:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623010.110715:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d71ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9da expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.110871:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.110957:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.110977:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.110995:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111003:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111010:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111128:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111137:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111145:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623010.111193:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788623010.111206:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623010.111242:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111258:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111269:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111276:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111285:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111292:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623010.111298:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111307:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111322:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788623010.111325:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623010.111331:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111338:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d71f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111354:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788623010.111607:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788623010.111670:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111676:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111681:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623010.111684:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111690:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111699:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e05312500) 00010000:00010000:0.0:1788623010.111702:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623010.111705:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111711:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d71fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111913:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d71ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 45 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111930:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.111938:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:0.0:1788623010.111941:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623010.111949:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9800, rc 0) 00000100:00100000:0.0:1788623010.112034:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+44:11435:x1875506858367744:12345-192.168.204.19@tcp:101:stat.0 Request processed in 1415us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623010.112043:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 158 00000100:00100000:2.0:1788623010.236814:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623010.236973:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858368000 00000100:00100000:3.0:1788623010.236985:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858368000 00000100:00100000:3.0:1788623010.237068:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 159 00000100:00100000:3.0:1788623010.237080:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+44:11445:x1875506858368000:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623010.237102:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623010.237140:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d720b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9e1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623010.237238:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788623010.237387:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d720b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e1 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.237403:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:3.0:1788623010.237406:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788623010.237412:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d720b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e1 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.237428:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734800, rc 0) 00000100:00100000:3.0:1788623010.237490:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+45:11445:x1875506858368000:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 413us (693us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788623010.237497:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 159 00000100:00100000:1.0:1788623010.247190:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.247478:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858368256 00000100:00100000:0.0:1788623010.247491:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858368256 00000100:00100000:0.0:1788623010.247565:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:0.0:1788623010.247578:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+45:11445:x1875506858368256:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788623010.247964:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+46:11445:x1875506858368256:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 388us (787us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788623010.247973:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:0.0:1788623010.323096:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623010.323306:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858368512 00000100:00100000:3.0:1788623010.323317:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858368512 00000100:00100000:3.0:1788623010.323389:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 160 00000100:00100000:3.0:1788623010.323400:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+46:11451:x1875506858368512:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:3.0:1788623010.323424:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623010.323447:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d7219 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9e8 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.323562:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.323576:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.323601:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.323639:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.323665:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 47 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623010.323681:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866758784:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623010.323864:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e036c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788623010.336513:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.336607:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858368640 00000100:00100000:0.0:1788623010.336617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858368640 00010000:00010000:0.0:1788623010.336679:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 48 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623010.336731:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 65 00000100:00100000:0.0:1788623010.336786:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+48:2348:x1875506858368640:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623010.336801:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623010.336809:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 48 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.336824:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 48 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.336848:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:0.0:1788623010.336876:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.336888:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.336897:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.336919:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623010.336972:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+48:2348:x1875506858368640:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 232us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623010.336980:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 65 00010000:00010000:3.0:1788623010.338080:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9da expref: 47 pid: 5809 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623010.338104:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a20f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866758784:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623010.338128:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.338138:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.338144:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623010.338165:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788623010.338334:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d7219 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 48 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.338381:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 47 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.338390:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788623010.338393:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788623010.338396:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734200, rc 0) 00000100:00100000:3.0:1788623010.338503:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+47:11451:x1875506858368512:12345-192.168.204.19@tcp:101:bash.0 Request processed in 15105us (15422us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788623010.338512:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 160 00000100:00100000:2.0:1788623010.349207:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623010.349509:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858368896 00000100:00100000:3.0:1788623010.349525:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858368896 00000100:00100000:3.0:1788623010.349608:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 161 00000100:00100000:3.0:1788623010.349622:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+47:11451:x1875506858368896:12345-192.168.204.19@tcp:36:bash.0 00010000:00010000:3.0:1788623010.350269:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.350296:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.350312:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788623010.350452:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788623010.350483:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdba8ab7 reply state 0000000091217d73 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623010.350493:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788623010.350799:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:11451:x1875506858368896:12345-192.168.204.19@tcp:36:bash.0 Request processed in 1178us (1601us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788623010.350817:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 161 00000020:00080000:3.0:1788623010.350824:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788623010.365632:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.365662:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.365671:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.365677:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623010.365683:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.365692:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.365716:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:3.0:1788623010.365719:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623010.365725:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.365733:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d722e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623010.377252:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.377865:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858369024 00000100:00100000:0.0:1788623010.377888:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858369024 00000100:00100000:0.0:1788623010.377976:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 162 00000100:00100000:0.0:1788623010.377989:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:11451:x1875506858369024:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788623010.378026:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623010.378059:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d7235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9ef expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.378192:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.378212:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 50 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.378222:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.378294:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 50 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.378311:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 50 pid: 6676 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623010.378328:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866758912:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623010.378461:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0792f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788623010.395247:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866758912:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788623010.395294:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623010.407440:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623010.408475:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858369152 00000100:00100000:1.0:1788623010.408490:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858369152 00010000:00010000:1.0:1788623010.408553:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 51 pid: 6676 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623010.408609:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 66 00000100:00100000:1.0:1788623010.408621:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:2349:x1875506858369152:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623010.408644:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623010.408665:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 51 pid: 6676 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.408682:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 51 pid: 6676 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.408732:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7220 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9e8 expref: 51 pid: 6676 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.408798:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623010.408805:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.408818:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.408827:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.408863:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623010.409129:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:2349:x1875506858369152:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 509us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623010.409139:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 66 00010000:00010000:2.0:1788623010.410135:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.410147:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623010.410212:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788623010.410218:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788623010.410248:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.410297:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d7235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9ef expref: 50 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.410320:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9ef expref: 49 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.410331:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788623010.410334:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623010.410338:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8200, rc 0) 00000100:00100000:2.0:1788623010.410423:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:11451:x1875506858369024:12345-192.168.204.19@tcp:101:bash.0 Request processed in 32436us (33183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623010.410431:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 162 00000100:00100000:2.0:1788623010.426798:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.427189:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858369408 00000100:00100000:0.0:1788623010.427205:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858369408 00000100:00100000:0.0:1788623010.427322:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:0.0:1788623010.427335:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+49:11451:x1875506858369408:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:0.0:1788623010.427706:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:11451:x1875506858369408:12345-192.168.204.19@tcp:35:bash.0 Request processed in 371us (920us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788623010.427716:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:1.0:1788623010.544240:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623010.544392:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858369664 00000100:00100000:2.0:1788623010.544405:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858369664 00000100:00100000:2.0:1788623010.544615:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 163 00000100:00100000:2.0:1788623010.544629:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:11460:x1875506858369664:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623010.544694:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623010.544725:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9f6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623010.544899:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788623010.546227:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7243 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9f6 expref: 52 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.546250:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:2.0:1788623010.546254:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623010.546260:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9f6 expref: 52 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.546278:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623010.547814:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:11460:x1875506858369664:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 3178us (3576us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788623010.547838:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 163 00000100:00100000:3.0:1788623010.555895:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623010.556012:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858369792 00000100:00100000:1.0:1788623010.556026:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858369792 00000100:00100000:1.0:1788623010.556100:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 164 00000100:00100000:1.0:1788623010.556116:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:11460:x1875506858369792:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:1.0:1788623010.556224:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556245:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556260:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556296:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556303:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556310:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556438:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556448:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556456:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623010.556526:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556542:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556549:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556557:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556563:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623010.556568:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556585:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556600:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623010.556604:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623010.556609:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556616:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556631:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556637:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556643:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556659:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623010.556661:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556668:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556675:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991800) 00010000:00010000:1.0:1788623010.556678:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623010.556680:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556699:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d7258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556716:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556722:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556728:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556732:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623010.556735:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556784:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556793:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623010.556795:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623010.556798:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.556804:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d725f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623010.556903:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:11460:x1875506858369792:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 791us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623010.556912:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 164 00000100:00100000:1.0:1788623010.559929:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623010.560192:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858370048 00000100:00100000:2.0:1788623010.560208:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858370048 00000100:00100000:2.0:1788623010.560272:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:2.0:1788623010.560284:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:11460:x1875506858370048:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:2.0:1788623010.560848:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:11460:x1875506858370048:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 563us (926us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788623010.560858:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:3.0:1788623010.600168:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.600583:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858370304 00000100:00100000:0.0:1788623010.600599:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858370304 00000100:00100000:0.0:1788623010.600696:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 165 00000100:00100000:0.0:1788623010.600710:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:11464:x1875506858370304:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623010.600789:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623010.600826:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d7266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120e9fd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601187:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601211:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601226:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601245:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601252:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601260:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601437:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d727b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601448:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.601456:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623010.602056:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788623010.603032:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603048:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603058:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603065:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623010.603160:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603171:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603194:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623010.603197:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623010.603205:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603213:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d726d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603235:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603242:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603248:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603274:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623010.603277:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603284:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603293:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e05312500) 00010000:00010000:1.0:1788623010.603296:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623010.603298:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603304:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603382:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d7266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9fd expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603399:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d727b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9fd expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.603408:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623010.603411:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788623010.603413:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8a00, rc 0) 00000100:00100000:1.0:1788623010.603842:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11464:x1875506858370304:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 3132us (3684us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788623010.603853:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 165 00000100:00100000:3.0:1788623010.609320:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623010.609602:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858370432 00000100:00100000:1.0:1788623010.609631:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858370432 00000100:00100000:1.0:1788623010.609817:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 166 00000100:00100000:1.0:1788623010.609830:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11464:x1875506858370432:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:1.0:1788623010.611880:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.611910:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.611926:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.611967:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.611974:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.611982:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.611987:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623010.611992:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.612001:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.612015:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623010.612018:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788623010.612024:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.612054:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623010.612181:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11464:x1875506858370432:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 2347us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623010.612192:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 166 00000100:00100000:3.0:1788623010.612847:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623010.613703:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858370560 00000100:00100000:0.0:1788623010.613717:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858370560 00000100:00100000:0.0:1788623010.614336:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:0.0:1788623010.614376:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:2349:x1875506858370560:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623010.614397:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623010.614429:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d727b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9fd expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623010.614453:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:0.0:1788623010.614459:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623010.614530:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+53:2349:x1875506858370560:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 158us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623010.614538:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:2.0:1788623010.616867:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623010.617580:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858370816 00000100:00100000:1.0:1788623010.617593:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858370816 00000100:00100000:1.0:1788623010.617670:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:1.0:1788623010.617683:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+53:11464:x1875506858370816:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788623010.618162:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11464:x1875506858370816:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 480us (1303us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788623010.618172:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 47 00010000:00010000:1.0:1788623010.731975:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788623010.796157:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788623010.796187:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788623010.799852:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788623010.799870:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788623010.835870:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623010.837757:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858371072 00000100:00100000:2.0:1788623010.837776:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858371072 00000100:00100000:2.0:1788623010.837880:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 167 00000100:00100000:2.0:1788623010.837894:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11482:x1875506858371072:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:2.0:1788623010.837930:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623010.837960:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea04 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.838116:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7297 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.838135:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.838151:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623010.838165:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788623010.838796:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea04 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.838838:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea04 expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623010.838848:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:2.0:1788623010.838851:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788623010.838876:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623010.839080:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11482:x1875506858371072:12345-192.168.204.19@tcp:101:cat.0 Request processed in 1188us (3222us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788623010.839089:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 167 00000100:00100000:1.0:1788623010.886596:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623010.887430:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858371200 00000100:00100000:3.0:1788623010.887445:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858371200 00000100:00100000:3.0:1788623010.887533:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 168 00000100:00100000:3.0:1788623010.887547:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11483:x1875506858371200:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623010.887583:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623010.887614:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea0b expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.887798:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d72ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.888012:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d72ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.888030:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d72ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623010.888089:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788623010.888093:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788623010.888117:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d72ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.888152:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea0b expref: 58 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.888176:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d72ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea0b expref: 57 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.888185:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623010.888196:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788623010.888202:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735a00, rc 0) 00000100:00100000:3.0:1788623010.888286:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11483:x1875506858371200:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 741us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623010.888294:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 168 00000100:00100000:1.0:1788623010.903491:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623010.903666:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858371584 00000100:00100000:2.0:1788623010.903681:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858371584 00000100:00100000:2.0:1788623010.903806:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:2.0:1788623010.903819:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11483:x1875506858371584:12345-192.168.204.19@tcp:35:lfs.0 00000001:00080000:2.0:1788623010.905899:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967456 00000100:00100000:2.0:1788623010.907464:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11483:x1875506858371584:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 3637us (3981us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788623010.907479:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 48 00000020:00080000:2.0:1788623010.907489:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788623010.913659:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623010.914598:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858371712 00000100:00100000:1.0:1788623010.914656:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858371712 00000100:00100000:1.0:1788623010.914820:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:1.0:1788623010.914834:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11483:x1875506858371712:12345-192.168.204.19@tcp:103:lfs.0 00010000:00010000:1.0:1788623010.914855:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788623010.914889:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d723c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9ef expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.914917:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d7297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea04 expref: 58 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.914965:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e9b0 expref: 57 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623010.914990:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0400) 00010000:00010000:1.0:1788623010.915004:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623010.915106:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11483:x1875506858371712:12345-192.168.204.19@tcp:103:lfs.0 Request processed in 275us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623010.915115:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:1.0:1788623010.918810:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623010.919126:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858371840 00000100:00100000:3.0:1788623010.919142:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858371840 00000100:00100000:3.0:1788623010.919237:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 169 00000100:00100000:3.0:1788623010.919250:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11483:x1875506858371840:12345-192.168.204.19@tcp:58:lfs.0 00010000:00010000:3.0:1788623010.919400:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.919421:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.919435:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788623010.919782:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788623010.919895:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11483:x1875506858371840:12345-192.168.204.19@tcp:58:lfs.0 Request processed in 646us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623010.919905:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 169 00000100:00100000:2.0:1788623010.949662:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623010.951280:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858371968 00000100:00100000:3.0:1788623010.951299:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858371968 00000100:00100000:3.0:1788623010.951401:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 170 00000100:00100000:3.0:1788623010.951414:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11485:x1875506858371968:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623010.951440:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623010.951471:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d72ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea12 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951588:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951619:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951636:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951665:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951673:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951681:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951833:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951842:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951849:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623010.951898:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788623010.951903:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788623010.951928:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951954:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951965:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951985:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951992:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.951999:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623010.952003:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952012:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952027:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623010.952031:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623010.952035:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952052:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d72c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952067:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952073:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952085:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952090:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623010.952093:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952099:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952107:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11ed0700) 00010000:00010000:3.0:1788623010.952109:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623010.952112:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952118:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d72c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952159:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d72ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 58 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952174:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 57 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623010.952183:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:3.0:1788623010.952185:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788623010.952188:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fba00, rc 0) 00000100:00100000:3.0:1788623010.952285:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11485:x1875506858371968:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 873us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623010.952303:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 170 00000100:00100000:1.0:1788623011.372181:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788623011.372216:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866759040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788623011.372318:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623011.372452:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866759040 00000100:00100000:0.0:1788623011.372465:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866759040 00000100:00100000:0.0:1788623011.372543:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788623011.372556:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866759040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788623011.372610:0:6659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623011.372702:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866759040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623011.372710:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788623011.372852:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866759040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788623011.373876:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788623011.757494:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788623011.821284:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788623011.821296:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788623011.822048:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788623011.822059:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788623011.822348:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a2d1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866759168:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788623011.822495:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2f1630c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623011.826149:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a2d1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866759168:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788623011.842590:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623011.842653:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858372096 00000100:00100000:1.0:1788623011.842666:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858372096 00000100:00100000:1.0:1788623011.842732:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 171 00000100:00100000:1.0:1788623011.842756:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11496:x1875506858372096:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788623011.842800:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788623011.842918:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11496:x1875506858372096:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 177us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623011.842926:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 171 00000100:00100000:2.0:1788623011.853334:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623011.853446:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858372224 00000100:00100000:0.0:1788623011.853459:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858372224 00000100:00100000:0.0:1788623011.853529:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 172 00000100:00100000:0.0:1788623011.853541:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11496:x1875506858372224:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788623011.853647:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853670:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853694:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853712:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853720:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853727:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853803:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853814:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853821:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623011.853882:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788623011.853888:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623011.853904:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853917:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853925:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853945:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853952:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623011.853958:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853968:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.853982:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:0.0:1788623011.853986:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623011.853992:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854000:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d72d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854013:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854020:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854026:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854032:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623011.854035:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854051:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854059:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff997e05312400) 00010000:00010000:0.0:1788623011.854062:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623011.854065:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854071:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d72dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854089:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854095:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854102:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854108:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623011.854111:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854118:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854126:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788623011.854128:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623011.854131:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.854147:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d72e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623011.854260:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11496:x1875506858372224:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 Request processed in 718us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623011.854270:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 172 00000100:00100000:2.0:1788623011.857103:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623011.857148:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858372480 00000100:00100000:2.0:1788623011.857161:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858372480 00000100:00100000:2.0:1788623011.857231:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 173 00000100:00100000:2.0:1788623011.857244:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11496:x1875506858372480:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623011.857283:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623011.857312:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d72eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea19 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857449:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857468:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857483:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623011.857496:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788623011.857659:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857668:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857676:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857682:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623011.857687:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857697:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857712:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:2.0:1788623011.857721:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788623011.857768:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857777:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d72f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857829:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d72eb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea19 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857840:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:2.0:1788623011.857843:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623011.857847:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d72eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea19 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.857857:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad400, rc 0) 00000100:00100000:2.0:1788623011.857928:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11496:x1875506858372480:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 687us (836us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1788623011.857935:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 173 00000100:00100000:3.0:1788623011.860516:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623011.860563:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858372608 00000100:00100000:3.0:1788623011.860574:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858372608 00000100:00100000:3.0:1788623011.860664:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 174 00000100:00100000:3.0:1788623011.860677:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11496:x1875506858372608:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788623011.860981:0:5810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788623011.861170:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11496:x1875506858372608:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 495us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623011.861180:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 174 00000100:00100000:2.0:1788623011.869537:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623011.869600:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858372864 00000100:00100000:3.0:1788623011.869614:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858372864 00000100:00100000:3.0:1788623011.869695:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 175 00000100:00100000:3.0:1788623011.869715:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11496:x1875506858372864:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788623011.869759:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623011.869764:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788623011.869799:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d72ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea0b expref: 58 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.869823:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623011.869829:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788623011.869847:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d7300 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea20 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788623011.870654:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788623011.871178:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.871198:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.872312:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.872601:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fac00/0xef842f43731d7300 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea20 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.872638:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea20 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.872648:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11ed0700) 00010000:00010000:3.0:1788623011.872651:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788623011.872655:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735200, rc 0) 00000100:00100000:3.0:1788623011.872770:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11496:x1875506858372864:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 3063us (3243us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788623011.872782:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 175 00000100:00100000:2.0:1788623011.880480:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623011.880678:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858373120 00000100:00100000:0.0:1788623011.880693:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858373120 00000100:00100000:0.0:1788623011.880795:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 176 00000100:00100000:0.0:1788623011.880808:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11496:x1875506858373120:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788623011.881004:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623011.881043:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d7307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea20 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881064:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11ed0700) 00010000:00010000:0.0:1788623011.881079:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788623011.881111:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881127:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881140:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881156:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881163:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881180:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881531:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881541:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881548:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881554:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623011.881558:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881567:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881578:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788623011.881581:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623011.881585:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881591:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7315 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881601:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881607:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881635:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881640:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623011.881643:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881650:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881657:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd2454a97 (ffff997e05312400) 00010000:00010000:0.0:1788623011.881659:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623011.881663:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623011.881668:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d731c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd2454a97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623011.882289:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11496:x1875506858373120:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1480us (1816us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788623011.882299:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 176 00000100:00100000:0.0:1788623011.898445:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623011.898650:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858373248 00000100:00100000:1.0:1788623011.898663:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858373248 00000100:00100000:1.0:1788623011.898802:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 177 00000100:00100000:1.0:1788623011.898817:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11496:x1875506858373248:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623011.898846:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623011.898880:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7323 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea27 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.898929:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.898959:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.898975:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.899107:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.899127:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.899139:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623011.899143:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788623011.899148:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db800, rc 0) 00000100:00100000:1.0:1788623011.899249:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11496:x1875506858373248:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 436us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623011.899257:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 177 00000100:00100000:2.0:1788623011.903283:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623011.906006:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858373504 00000100:00100000:0.0:1788623011.906024:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858373504 00000100:00100000:2.0:1788623011.909569:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 178 00000100:00100000:2.0:1788623011.909586:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11496:x1875506858373504:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788623011.909720:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.909768:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.909794:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788623011.910247:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788623011.910261:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335865517541ns, next at 336865514309ns, rc = 0 00000004:00010000:2.0:1788623011.910389:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005225a901 reply state 0000000067fc158b transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623011.910400:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788623011.910534:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11496:x1875506858373504:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 950us (7262us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788623011.910543:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 178 00010000:00010000:3.0:1788623011.913400:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.913418:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.913439:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.913447:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623011.913453:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.913463:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.913485:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:3.0:1788623011.913489:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788623011.913494:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.913501:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7331 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623011.913999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623011.916676:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858373632 00000100:00100000:3.0:1788623011.916694:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858373632 00000100:00100000:3.0:1788623011.917210:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 179 00000100:00100000:3.0:1788623011.917225:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11496:x1875506858373632:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788623011.917259:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623011.917288:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea2e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.917441:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.917475:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.917506:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:3.0:1788623011.917509:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788623011.917514:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735a00, rc 0) 00000100:00100000:3.0:1788623011.917609:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11496:x1875506858373632:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 388us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623011.917618:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 179 00000100:00100000:0.0:1788623011.921337:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623011.921401:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858373760 00000100:00100000:3.0:1788623011.921414:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858373760 00000100:00100000:3.0:1788623011.921502:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:3.0:1788623011.921516:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858373760:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788623011.923141:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858373760:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 1621us (1807us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788623011.923154:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00080000:0.0:1788623011.923589:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788623011.929261:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623011.929494:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858374016 00000100:00100000:0.0:1788623011.929509:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858374016 00000100:00100000:0.0:1788623011.929590:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:0.0:1788623011.929603:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11496:x1875506858374016:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788623011.930094:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11496:x1875506858374016:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 484us (836us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788623011.930104:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:3.0:1788623011.932302:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623011.932679:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858374272 00000100:00100000:2.0:1788623011.932690:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858374272 00000100:00100000:2.0:1788623011.932783:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 180 00000100:00100000:2.0:1788623011.932796:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11496:x1875506858374272:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788623011.933329:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11496:x1875506858374272:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 525us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623011.933339:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 180 00000100:00100000:3.0:1788623011.940005:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623011.940135:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858374400 00000100:00100000:1.0:1788623011.940154:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858374400 00000100:00100000:1.0:1788623011.940379:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 181 00000100:00100000:1.0:1788623011.940396:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11496:x1875506858374400:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623011.940493:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623011.940526:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d733f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea35 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.941390:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.941411:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.941426:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623011.941477:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623011.941501:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.941538:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d733f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea35 expref: 64 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.941557:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea35 expref: 63 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.941568:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623011.941572:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788623011.941576:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0daa00, rc 0) 00000100:00100000:1.0:1788623011.942433:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+63:11496:x1875506858374400:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 2037us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623011.942461:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 181 00000100:00100000:0.0:1788623011.950901:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623011.951396:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858374528 00000100:00100000:2.0:1788623011.951410:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858374528 00000100:00100000:2.0:1788623011.951481:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:2.0:1788623011.951492:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858374528:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623011.951513:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623011.951545:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea3c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788623011.951578:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c38a4, blocks: 0x1 00010000:00010000:2.0:1788623011.951612:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788623011.951617:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623011.951635:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 8 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.951657:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 8 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623011.951674:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad000, rc 0) 00000100:00100000:2.0:1788623011.951767:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858374528:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 277us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623011.951776:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:2.0:1788623011.957107:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623011.957304:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858374784 00000100:00100000:1.0:1788623011.957317:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858374784 00000100:00100000:1.0:1788623011.958122:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 182 00000100:00100000:1.0:1788623011.958140:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+63:11496:x1875506858374784:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788623011.958885:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+63:11496:x1875506858374784:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 748us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623011.958896:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 182 00000100:00100000:3.0:1788623011.966559:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623011.969772:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858374912 00000100:00100000:1.0:1788623011.969801:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858374912 00000100:00100000:1.0:1788623011.969884:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:1.0:1788623011.969897:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:11496:x1875506858374912:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623011.969932:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623011.969961:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea43 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.970007:0:8422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.970018:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623011.970023:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623011.970029:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 9 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.970074:0:8422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.970100:0:8422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623011.970117:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8422:1875506866759296:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623011.970254:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788623011.974220:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8422:1875506866759296:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623011.974272:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 9 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623011.974301:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da800, rc 0) 00000100:00100000:3.0:1788623011.974405:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:11496:x1875506858374912:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 4509us (7855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623011.974416:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:2.0:1788623011.977478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623011.978493:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375040 00000100:00100000:1.0:1788623011.978507:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375040 00010000:00010000:1.0:1788623011.978569:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623011.978680:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:1.0:1788623011.978693:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858375040:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623011.978712:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623011.978767:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.978784:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.978823:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b777ce/0xef842f43731d734d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea3c expref: 9 pid: 6655 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.978840:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623011.978861:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623011.978873:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.978885:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623011.979440:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623011.979462:0:5794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5794:1875506866759424:192.168.204.19@tcp:105: 00000100:00100000:1.0:1788623011.979587:0:5794:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548180 going to sleep for 11 seconds 00000100:00100000:3.0:1788623011.987148:0:5794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5794:1875506866759424:192.168.204.19@tcp:105: 00010000:00010000:3.0:1788623011.987189:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623011.987260:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858375040:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 8568us (9792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623011.987274:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:3.0:1788623011.994505:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623011.994552:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375168 00000100:00100000:3.0:1788623011.994566:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375168 00002000:00100000:3.0:1788623011.994651:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff997e3978e680 x1875506858375168/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:87/0 lens 504/0 e 0 to 0 dl 1788623022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788623011.994664:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3978e680 with x1875506858375168 ext(0->8) 00002000:00010000:3.0:1788623011.994672:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e3978e680 00000100:00100000:3.0:1788623011.995020:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:3.0:1788623011.995034:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858375168:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788623011.996186:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2348:x1875506858375168:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 Request processed in 1149us (1695us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788623011.996198:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00002000:00100000:3.0:1788623011.996210:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff997e3978e680 x1875506858375168/t4294967314(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:87/0 lens 504/448 e 0 to 0 dl 1788623022 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788623011.996220:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e3978e680 with x1875506858375168 ext(0->8) 00002000:00010000:3.0:1788623011.996226:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e3978e680 00000100:00100000:2.0:1788623012.003231:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623012.003300:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375296 00000100:00100000:3.0:1788623012.003314:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375296 00000100:00100000:3.0:1788623012.003421:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 183 00000100:00100000:3.0:1788623012.003434:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+63:11496:x1875506858375296:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1788623012.003889:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788623012.060550:0:12367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788623012.060562:0:12367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788623012.060648:0:12367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788623012.060656:0:12367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788623012.062518:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623012.062568:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623012.062598:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623012.062720:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375552 00000100:00100000:2.0:1788623012.062734:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375552 00000100:00100000:2.0:1788623012.062847:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:2.0:1788623012.062861:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858375552:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623012.062973:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858375552:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623012.062991:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:3.0:1788623012.064366:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375424 00000100:00100000:3.0:1788623012.064383:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375424 00000100:00100000:3.0:1788623012.064457:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 298 00000100:00100000:3.0:1788623012.064471:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858375424:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623012.064565:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2348:x1875506858375424:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 98us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623012.064575:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 298 00000100:00080000:0.0:1788623012.065807:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788623012.067197:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375680 00000100:00100000:1.0:1788623012.067214:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375680 00000100:00080000:0.0:1788623012.067669:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623012.067978:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 155 00000100:00100000:1.0:1788623012.067993:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858375680:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623012.068787:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2348:x1875506858375680:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 796us (6184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623012.068798:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 155 00000100:00100000:3.0:1788623012.079691:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+63:11496:x1875506858375296:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 Request processed in 76243us (76457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623012.079708:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 183 00000001:00080000:3.0:1788623012.079792:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1788623012.079810:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788623012.079831:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e0792f480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788623012.079836:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e07e27400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e0792f9c0 00000020:00080000:3.0:1788623012.079839:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e07e27b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997d0544fc00 00000004:00080000:3.0:1788623012.079874:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788623012.080243:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788623012.080534:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788623012.080650:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866759552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788623012.080716:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623012.083540:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866759680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788623012.083653:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623012.085273:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866759552 00000100:00100000:3.0:1788623012.085298:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866759552 00000100:00100000:3.0:1788623012.085371:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866759680 00000100:00100000:3.0:1788623012.085375:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866759680 00000100:00100000:3.0:1788623012.085403:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788623012.085415:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866759552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788623012.085457:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00100000:1.0:1788623012.085492:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00002000:00010000:3.0:1788623012.085503:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c38a1, atime: 0x6a9c38a1, ctime: 0x6a9c38a1, blocks: 0x1 00010000:00010000:3.0:1788623012.085512:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.085531:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1788623012.085537:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623012.085545:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.085566:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.085579:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.085588:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.085630:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788623012.086929:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1875506866759552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1510us (6207us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788623012.086942:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788623012.086966:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858375808 00000100:00100000:3.0:1788623012.086973:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858375808 00000100:00100000:3.0:1788623012.087000:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788623012.087009:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866759680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788623012.087159:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788623012.087163:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788623012 00002000:00010000:3.0:1788623012.087165:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788623012.087167:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788623012 -> 1788623012 00002000:00010000:3.0:1788623012.087169:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788623012.087216:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1875506866759680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (3562us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788623012.087222:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788623012.087237:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00100000:3.0:1788623012.087244:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2351:x1875506858375808:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788623012.087297:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997d0770b100/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788623012.087305:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866759680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788623012.087486:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e2f2ced80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788623012.087492:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866759552:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788623012.087594:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788623012.087607:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623012.087627:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.087712:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623012.087718:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.087764:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.087925:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.087935:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe71142/0xef842f43731d735b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.087954:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623012.087956:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623012.087958:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623012.138652:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2351:x1875506858375808:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 Request processed in 51393us (53148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623012.138668:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 55 00000001:00080000:2.0:1788623012.138714:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1788623012.138726:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788623012.141697:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623012.141819:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858376064 00000100:00100000:1.0:1788623012.141832:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858376064 00000100:00100000:1.0:1788623012.141910:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 184 00000100:00100000:1.0:1788623012.141922:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0612d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11496:x1875506858376064:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788623012.142118:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623012.142158:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea35 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.142179:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623012.142186:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788623012.142269:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.142287:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.142301:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623012.142892:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed3d42b5 reply state 00000000931eee27 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623012.142904:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788623012.143228:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0612d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:11496:x1875506858376064:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1303us (1534us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788623012.143237:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 184 00010000:00010000:2.0:1788623012.146296:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.146318:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.146327:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.146335:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623012.146342:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.146361:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.146383:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:2.0:1788623012.146388:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623012.146394:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.146418:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d7362 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623012.149922:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623012.150070:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858376192 00000100:00100000:0.0:1788623012.150095:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858376192 00000100:00100000:0.0:1788623012.150165:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 56 00000100:00100000:0.0:1788623012.150177:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858376192:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788623012.150858:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788623012.150863:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788623012 -> 1788623011 00002000:00010000:0.0:1788623012.150865:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788623009 00002000:00010000:0.0:1788623012.150868:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788623012 -> 1788623011 00002000:00010000:0.0:1788623012.150870:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788623012.150949:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2350:x1875506858376192:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 772us (1039us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788623012.150958:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 56 00000100:00100000:3.0:1788623012.153305:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623012.153400:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858376448 00000100:00100000:1.0:1788623012.153413:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858376448 00000100:00100000:1.0:1788623012.153482:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 185 00000100:00100000:1.0:1788623012.153493:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11496:x1875506858376448:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788623012.153581:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.153629:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.153649:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.153694:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.153710:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 18 pid: 5809 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623012.153727:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866759808:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623012.153857:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548180 going to sleep for 11 seconds 00000100:00100000:3.0:1788623012.157719:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623012.157783:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858376576 00000100:00100000:1.0:1788623012.157903:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866759808:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623012.157921:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858376576 00010000:00010000:1.0:1788623012.157942:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.157967:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 19 pid: 5809 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623012.158013:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:2.0:1788623012.158024:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:2348:x1875506858376576:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788623012.158044:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623012.158053:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 19 pid: 5809 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.158068:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 19 pid: 5809 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.158172:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d732a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea27 expref: 19 pid: 5809 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.158191:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:2.0:1788623012.158196:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.158208:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.158230:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623012.158266:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623012.158465:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2348:x1875506858376576:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 441us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623012.158474:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 68 00010000:00010000:1.0:1788623012.158665:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158673:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158711:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158720:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158735:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158763:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0daa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623012.158769:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158778:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158792:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623012.158795:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788623012.158798:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.158805:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d7369 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623012.163002:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:11496:x1875506858376448:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 Request processed in 9495us (9693us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788623012.163020:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 185 00000100:00100000:3.0:1788623012.167604:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623012.169575:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858376704 00000100:00100000:0.0:1788623012.169594:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858376704 00000100:00100000:0.0:1788623012.169839:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:0.0:1788623012.169853:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2351:x1875506858376704:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788623012.169919:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.169944:0:6657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.169954:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788623012.169959:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623012.169965:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.170011:0:6657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 8 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.170029:0:6657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 8 pid: 8422 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623012.170044:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6657:1875506866759936:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623012.170167:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623012.179970:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6657:1875506866759936:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623012.180013:0:6657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623012.180369:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623012.181546:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858376832 00000100:00100000:3.0:1788623012.181560:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858376832 00010000:00010000:3.0:1788623012.181816:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 9 pid: 8422 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623012.182711:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:3.0:1788623012.182737:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858376832:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623012.182783:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623012.182820:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 9 pid: 8422 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.182839:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 9 pid: 8422 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.182876:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bad5087/0xef842f43731d7354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea43 expref: 9 pid: 8422 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.182899:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623012.182905:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623012.182913:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.182926:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.182965:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788623012.182987:0:6657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.182998:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.183041:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623012.183051:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858376832:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 321us (2684us total) trans 0 rc 0/0 00010000:00010000:0.0:1788623012.183051:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623012.183060:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 69 00010000:00010000:0.0:1788623012.183061:0:6657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.183069:0:6657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623012.183074:0:6657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.183362:0:6657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.183377:0:6657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.183385:0:6657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7370 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623012.183442:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2351:x1875506858376704:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 Request processed in 13593us (15850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623012.183451:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:0.0:1788623012.194503:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623012.194561:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858377088 00000100:00100000:0.0:1788623012.194574:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858377088 00000100:00100000:0.0:1788623012.194657:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 186 00000100:00100000:0.0:1788623012.194679:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+17:11496:x1875506858377088:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788623012.194812:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.194835:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.194851:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.195190:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.195204:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.195215:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.195265:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.195356:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 18 pid: 5811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623012.195374:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866760064:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623012.195487:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788623012.200092:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623012.200134:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858377216 00000100:00100000:1.0:1788623012.200145:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858377216 00010000:00010000:1.0:1788623012.200195:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 19 pid: 5811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623012.200246:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 70 00000100:00100000:1.0:1788623012.200258:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:2349:x1875506858377216:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623012.200280:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623012.200289:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 19 pid: 5811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.200324:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 19 pid: 5811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.200358:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623012.200366:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.200379:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.200389:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.200415:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623012.200492:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:2349:x1875506858377216:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 236us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623012.200501:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 70 00010000:00010000:3.0:1788623012.201121:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea2e expref: 18 pid: 5811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623012.201140:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03285180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866760064:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623012.201181:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.201191:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.201197:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788623012.201452:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788623012.201660:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788623012.201717:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788623012.201861:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6676:1875506866760192:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788623012.201940:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623012.201994:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e011ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623012.202172:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866760192 00000100:00100000:0.0:1788623012.202183:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866760192 00000100:00100000:0.0:1788623012.202232:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788623012.202242:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6676:x1875506866760192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788623012.202564:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6676:x1875506866760192:12345-0@lo:1000:mdt00_003.0 Request processed in 322us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623012.202572:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788623012.206217:0:6676:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788623012.206231:0:6676:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997d0770b100, transno 4294967315 00000100:00100000:3.0:1788623012.206562:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6676:1875506866760192:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788623012.207199:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788623012.207318:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6676:1875506866760320:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788623012.207410:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623012.207466:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e12071d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788623012.208714:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866760320 00000100:00100000:1.0:1788623012.208728:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866760320 00000100:00100000:1.0:1788623012.208825:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788623012.208838:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6676:x1875506866760320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788623012.209171:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6676:x1875506866760320:12345-0@lo:1000:mdt00_003.0 Request processed in 335us (1759us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788623012.209180:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788623012.209241:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6676:1875506866760320:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788623012.209296:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209319:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209327:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209334:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623012.209341:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209350:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209371:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623012.209375:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788623012.209381:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209388:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d737e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209426:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209434:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209441:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209447:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623012.209458:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209466:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209476:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:1.0:1788623012.209479:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788623012.209483:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209490:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d72b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209516:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209534:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 21 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209545:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209581:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 21 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.209600:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 21 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623012.209629:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866760448:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623012.209725:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548180 going to sleep for 11 seconds 00000100:00100000:1.0:1788623012.217090:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623012.217362:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858377344 00000100:00100000:0.0:1788623012.217375:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858377344 00010000:00010000:0.0:1788623012.217426:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 22 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623012.217464:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 71 00000100:00100000:0.0:1788623012.217474:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:2349:x1875506858377344:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623012.217493:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623012.217500:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 22 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.217516:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 22 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.217546:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788623012.217552:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.217565:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.217584:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.217609:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623012.217696:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:2349:x1875506858377344:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 223us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623012.217705:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 71 00010000:00010000:3.0:1788623012.224218:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d72cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea12 expref: 21 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623012.224251:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6676:1875506866760448:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623012.224287:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224487:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224495:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224512:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224520:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224528:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224535:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dbc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623012.224541:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224549:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224570:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788623012.224574:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623012.224587:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224594:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7385 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224608:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224623:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224629:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224638:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623012.224641:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224647:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224655:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0a00) 00010000:00010000:0.0:1788623012.224658:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788623012.224660:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623012.224666:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9c00/0xef842f43731d7377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623012.225297:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11496:x1875506858377088:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 30623us (30802us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788623012.225309:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 186 00000020:00080000:0.0:1788623012.225322:0:6676:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788623012.225469:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788623012.225474:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788623012.226495:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788623012.226509:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788623012.234283:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623012.234398:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858377600 00000100:00100000:3.0:1788623012.234411:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858377600 00000100:00100000:3.0:1788623012.234492:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:3.0:1788623012.234504:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11496:x1875506858377600:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788623012.235330:0:5813:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788623012.235445:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1788623012.235501:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.235523:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.235538:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.235549:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.235557:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.235564:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623012.235584:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788623012.235723:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:11496:x1875506858377600:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 1218us (1451us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788623012.235733:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 50 00000020:00080000:3.0:1788623012.235759:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788623012.236200:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623012.236210:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.236218:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623012.236223:0:7601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.236234:0:7601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.236251:0:7601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff997e11ed0e00) 00010000:00010000:1.0:1788623012.236254:0:7601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788623012.236260:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.236267:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d738c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623012.236290:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623012.236292:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623012.236294:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788623012.470435:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788623012.470551:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788623012.470667:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00010000:00010000:1.0:1788623012.780092:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623012.909057:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866760576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623012.909171:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623012.909340:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866760576 00000100:00100000:2.0:1788623012.909362:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866760576 00000100:00100000:2.0:1788623012.909438:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788623012.909450:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866760576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788623012.909502:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623012.909577:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866760576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623012.909585:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788623012.911436:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788623012.911937:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788623012.911946:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788623012.911978:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e2f2ced80, transno 4294967307 00000100:00100000:1.0:1788623012.912019:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a00b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866760576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623012.915030:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866760832:0@lo:400:kworker.0 00000100:00100000:3.0:1788623012.915145:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623012.915194:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866760704:0@lo:400:kworker.0 00000100:00100000:3.0:1788623012.915230:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623012.915303:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866760832 00000100:00100000:3.0:1788623012.915314:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866760832 00000100:00100000:3.0:1788623012.915385:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788623012.915396:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866760832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623012.915413:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866760704 00000100:00100000:1.0:1788623012.915419:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866760704 00000100:00100000:3.0:1788623012.915465:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866760832:12345-0@lo:400:kworker.0 Request processed in 71us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623012.915471:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788623012.915473:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788623012.915479:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866760704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623012.915515:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0607d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866760704:12345-0@lo:400:kworker.0 Request processed in 38us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623012.915521:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866760832:0@lo:400:kworker.0 00000100:00100000:1.0:1788623012.915521:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788623012.915531:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866760704:0@lo:400:kworker.0 00000100:00100000:0.0:1788623012.918679:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788623012.924906:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866761088:0@lo:400:kworker.0 00000100:00100000:0.0:1788623012.925024:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623012.925093:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e03292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866760960:0@lo:400:kworker.0 00000100:00100000:0.0:1788623012.925117:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623012.925426:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866761088 00000100:00100000:1.0:1788623012.925440:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866761088 00000100:00100000:1.0:1788623012.925520:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866760960 00000100:00100000:1.0:1788623012.925524:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866760960 00000100:00100000:1.0:1788623012.925558:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788623012.925570:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866761088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623012.925654:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866761088:12345-0@lo:400:kworker.0 Request processed in 86us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623012.925662:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788623012.925685:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788623012.925692:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866760960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623012.925720:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866760960:12345-0@lo:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623012.925726:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1788623012.925830:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623012.925975:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866761088:0@lo:400:kworker.0 00000100:00100000:0.0:1788623012.925988:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e03292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866760960:0@lo:400:kworker.0 00010000:00010000:3.0:1788623013.804127:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788623014.070514:0:12420:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788623014.070526:0:12420:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788623014.070571:0:12420:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788623014.070578:0:12420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788623014.241798:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.241837:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858377856 00000100:00100000:3.0:1788623014.241846:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858377856 00000100:00080000:2.0:1788623014.242151:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788623014.242864:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 187 00000100:00100000:3.0:1788623014.242883:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:11514:x1875506858377856:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623014.242993:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623014.243017:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea4a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.243125:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d739a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.243157:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d739a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.243170:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d739a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623014.243184:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788623014.243321:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea4a expref: 25 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.243341:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d739a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea4a expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.243350:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623014.243352:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788623014.243356:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734c00, rc 0) 00000100:00100000:3.0:1788623014.243432:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:11514:x1875506858377856:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 555us (1646us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788623014.243439:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 187 00000100:00100000:1.0:1788623014.254083:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.254152:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858377984 00000100:00100000:3.0:1788623014.254163:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858377984 00000100:00100000:3.0:1788623014.254223:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 188 00000100:00100000:3.0:1788623014.254234:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:11514:x1875506858377984:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:3.0:1788623014.254314:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254332:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254356:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254374:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254382:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254388:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254677:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254686:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254693:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788623014.254736:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254816:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254823:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254829:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254844:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623014.254849:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254857:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254868:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623014.254871:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623014.254875:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254881:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d73a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254893:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254898:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.254904:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256023:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623014.256028:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256038:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256068:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11ed0000) 00010000:00010000:3.0:1788623014.256071:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623014.256074:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256080:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d73af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256100:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256107:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256113:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256117:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623014.256120:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256124:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256131:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11ed0700) 00010000:00010000:3.0:1788623014.256133:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623014.256136:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.256142:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623014.256246:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:11514:x1875506858377984:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 2010us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623014.256256:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 188 00000100:00100000:2.0:1788623014.344532:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.346175:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858378240 00000100:00100000:3.0:1788623014.346197:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858378240 00000100:00100000:0.0:1788623014.346510:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 189 00000100:00100000:0.0:1788623014.346521:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+24:11517:x1875506858378240:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623014.346544:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623014.346572:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d73bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea51 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.346695:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.346711:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.346724:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.346739:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.346766:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.346773:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347084:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347105:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347113:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623014.347124:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788623014.347220:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347227:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347240:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347246:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623014.347250:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347258:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347271:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788623014.347288:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623014.347293:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347300:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d73c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347315:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347322:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347328:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347333:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623014.347336:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347353:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347362:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e05312400) 00010000:00010000:0.0:1788623014.347364:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623014.347367:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347373:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9200/0xef842f43731d73cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347415:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d73bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347429:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.347436:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:0.0:1788623014.347438:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623014.347441:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8000, rc 0) 00000100:00100000:0.0:1788623014.347523:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11517:x1875506858378240:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1003us (3005us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788623014.347530:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 189 00000100:00100000:3.0:1788623014.357471:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.360211:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858378368 00000100:00100000:1.0:1788623014.360230:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858378368 00000100:00100000:1.0:1788623014.360327:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 190 00000100:00100000:1.0:1788623014.360339:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11517:x1875506858378368:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:1.0:1788623014.360416:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360455:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360468:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360495:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360502:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360509:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360514:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.360518:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360526:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360538:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:1.0:1788623014.360541:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788623014.360545:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.360551:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d73e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.360651:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11517:x1875506858378368:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 314us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623014.360665:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 190 00000100:00100000:1.0:1788623014.364208:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.364449:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858378624 00000100:00100000:3.0:1788623014.364465:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858378624 00000100:00100000:3.0:1788623014.364528:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:3.0:1788623014.364539:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11517:x1875506858378624:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:3.0:1788623014.366249:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:11517:x1875506858378624:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 1697us (2043us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788623014.366264:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:2.0:1788623014.403068:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.403206:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858378880 00000100:00100000:3.0:1788623014.403217:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858378880 00000100:00100000:3.0:1788623014.403351:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 191 00000100:00100000:3.0:1788623014.403362:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:11043:x1875506858378880:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:3.0:1788623014.403387:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623014.403408:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d73e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea58 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.403505:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.403519:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.403558:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.403598:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.403619:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 28 pid: 5809 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623014.403633:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866761216:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623014.403723:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07f3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788623014.407835:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866761216:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623014.407869:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623014.408811:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623014.409177:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858379008 00000100:00100000:0.0:1788623014.409187:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858379008 00010000:00010000:0.0:1788623014.409231:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 29 pid: 5809 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623014.409311:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:0.0:1788623014.409322:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:2349:x1875506858379008:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623014.409338:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623014.409345:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 29 pid: 5809 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.409357:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 29 pid: 5809 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.409379:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d73d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea51 expref: 29 pid: 5809 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.409397:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:0.0:1788623014.409402:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.409411:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.409419:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.409491:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623014.409557:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:2349:x1875506858379008:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 237us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623014.409565:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 72 00010000:00010000:3.0:1788623014.411093:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.411111:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623014.411134:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788623014.411367:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d73e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.411389:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.411417:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:3.0:1788623014.411420:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788623014.411423:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735200, rc 0) 00000100:00100000:3.0:1788623014.411521:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:11043:x1875506858378880:12345-192.168.204.19@tcp:101:bash.0 Request processed in 8160us (8465us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788623014.411529:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 191 00000100:00100000:2.0:1788623014.424147:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.424253:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858379264 00000100:00100000:1.0:1788623014.424266:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858379264 00000100:00100000:1.0:1788623014.424338:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 192 00000100:00100000:1.0:1788623014.424349:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:11043:x1875506858379264:12345-192.168.204.19@tcp:36:bash.0 00010000:00010000:1.0:1788623014.424646:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.424665:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.424679:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788623014.424732:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1788623014.424809:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cda7a78 reply state 0000000081b65c9f transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.424819:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788623014.424869:0:6676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1788623014.424977:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11043:x1875506858379264:12345-192.168.204.19@tcp:36:bash.0 Request processed in 629us (844us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788623014.424985:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 192 00000020:00080000:1.0:1788623014.424990:0:6676:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788623014.428260:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:3.0:1788623014.428381:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.428394:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.428402:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.428408:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623014.428413:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.428421:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.428438:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:3.0:1788623014.428441:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623014.428446:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.428452:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d73fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.428601:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858379392 00000100:00100000:1.0:1788623014.428612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858379392 00000100:00100000:1.0:1788623014.428703:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 193 00000100:00100000:1.0:1788623014.428714:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:11043:x1875506858379392:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788623014.428770:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623014.428790:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d7403 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea5f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.428863:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d7403 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea5f expref: 32 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.428879:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d7403 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea5f expref: 32 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.428897:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:1.0:1788623014.428900:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788623014.428902:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dae00, rc 0) 00000100:00100000:1.0:1788623014.428963:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11043:x1875506858379392:12345-192.168.204.19@tcp:101:bash.0 Request processed in 250us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623014.428969:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 193 00000100:00100000:0.0:1788623014.436469:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623014.436849:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858379520 00000100:00100000:2.0:1788623014.436860:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858379520 00000100:00100000:2.0:1788623014.436943:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 58 00000100:00100000:2.0:1788623014.436972:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:11043:x1875506858379520:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788623014.436992:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623014.437016:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea66 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788623014.437045:0:6655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c38a3, atime: 0x6a9c38a1, ctime: 0x6a9c38a3, blocks: 0xb 00010000:00010000:2.0:1788623014.437069:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788623014.437074:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623014.437083:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.437103:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.437117:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bac200, rc 0) 00000100:00100000:2.0:1788623014.437171:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:11043:x1875506858379520:12345-192.168.204.19@tcp:101:bash.0 Request processed in 203us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623014.437179:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 58 00000100:00080000:3.0:1788623014.437850:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788623014.446737:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.446983:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858379648 00000100:00100000:3.0:1788623014.446993:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858379648 00002000:00010000:3.0:1788623014.447036:0:6662:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788623014.447041:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e03292a00 with x1875506858379648 ext(0->18446744073709551615) 00002000:00010000:3.0:1788623014.447054:0:6662:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e03292a00. 00000100:00100000:3.0:1788623014.447089:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788623014.447100:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858379648:12345-192.168.204.19@tcp:10:bash.0 00002000:00010000:3.0:1788623014.447393:0:6662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788623014.447397:0:6662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788623011 -> 1788623015 00002000:00010000:3.0:1788623014.447399:0:6662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788623009 -> 1788623009 00002000:00010000:3.0:1788623014.447401:0:6662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788623011 -> 1788623015 00002000:00010000:3.0:1788623014.447404:0:6662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788623014.447455:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858379648:12345-192.168.204.19@tcp:10:bash.0 Request processed in 357us (732us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788623014.447463:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00002000:00010000:3.0:1788623014.447467:0:6662:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788623014.447469:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e03292a00 with x1875506858379648 ext(0->18446744073709551615) 00002000:00010000:3.0:1788623014.447474:0:6662:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e03292a00. 00000100:00100000:0.0:1788623014.537688:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.538069:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858379776 00000100:00100000:1.0:1788623014.538084:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858379776 00000100:00100000:1.0:1788623014.538166:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 194 00000100:00100000:1.0:1788623014.538179:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11531:x1875506858379776:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:1.0:1788623014.538355:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.538379:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.538394:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.538436:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.538444:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.538450:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539548:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539567:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539588:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623014.539644:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539658:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539665:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539673:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539680:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.539684:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539704:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539720:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623014.539723:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.539728:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539735:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7411 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539773:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539779:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539784:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539790:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.539792:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539798:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539823:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991b00) 00010000:00010000:1.0:1788623014.539826:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.539829:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539844:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539861:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539868:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539874:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539879:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dbc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.539883:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539898:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539907:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:1.0:1788623014.539910:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.539914:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.539921:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d741f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.540182:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11531:x1875506858379776:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 1999us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623014.540192:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 194 00000100:00100000:0.0:1788623014.592607:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.592793:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858380032 00000100:00100000:3.0:1788623014.592818:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858380032 00000100:00100000:1.0:1788623014.593027:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 195 00000100:00100000:1.0:1788623014.593045:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+32:11534:x1875506858380032:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788623014.593074:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623014.593103:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7426 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea6d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593203:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593221:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593236:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593254:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593261:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593365:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593720:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d743b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593730:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d743b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.593779:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d743b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623014.593818:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788623014.594478:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594491:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594499:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594506:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.594513:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594522:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594539:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623014.594542:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.594548:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594556:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d742d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594581:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594589:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594607:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594613:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.594617:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594624:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594632:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991b00) 00010000:00010000:1.0:1788623014.594635:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.594638:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594644:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594702:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7426 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea6d expref: 35 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594717:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d743b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea6d expref: 34 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.594725:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:1.0:1788623014.594728:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788623014.594731:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dbe00, rc 0) 00000100:00100000:1.0:1788623014.595080:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:11534:x1875506858380032:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 2039us (2484us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788623014.595101:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 195 00000100:00100000:2.0:1788623014.601155:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.601562:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858380160 00000100:00100000:3.0:1788623014.601587:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858380160 00000100:00100000:3.0:1788623014.601725:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 196 00000100:00100000:3.0:1788623014.601739:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:11534:x1875506858380160:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:3.0:1788623014.602238:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.602266:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.602288:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.602337:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.602357:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 34 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623014.602376:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866761344:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623014.602512:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0b7250c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623014.606276:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.606366:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866761344:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623014.606405:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623014.606769:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858380416 00000100:00100000:0.0:1788623014.606779:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858380416 00000100:00100000:0.0:1788623014.607097:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:0.0:1788623014.607111:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+35:5587:x1875506858380416:12345-192.168.204.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788623014.607559:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:5587:x1875506858380416:12345-192.168.204.19@tcp:35:ldlm_bl.0 Request processed in 450us (1294us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788623014.607578:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:0.0:1788623014.610645:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.610781:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858380544 00000100:00100000:1.0:1788623014.610794:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858380544 00010000:00010000:1.0:1788623014.610863:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 36 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.611036:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:1.0:1788623014.611048:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:2349:x1875506858380544:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623014.611071:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623014.611081:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 36 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.611096:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 36 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.611126:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d73ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea58 expref: 36 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.611147:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:1.0:1788623014.611154:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.611165:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.611174:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.611388:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623014.611467:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+35:2349:x1875506858380544:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 421us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623014.611476:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 73 00010000:00010000:0.0:1788623014.613228:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613248:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613358:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613368:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613378:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613385:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623014.613391:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613422:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613510:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:0.0:1788623014.613514:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788623014.613521:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.613529:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623014.613695:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:11534:x1875506858380160:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 11954us (12548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623014.613706:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 196 00000100:00100000:0.0:1788623014.617735:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.618049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858380800 00000100:00100000:1.0:1788623014.618063:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858380800 00000100:00100000:1.0:1788623014.618157:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:1.0:1788623014.618169:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+34:11534:x1875506858380800:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788623014.618553:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+35:11534:x1875506858380800:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 385us (828us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788623014.618562:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:2.0:1788623014.714377:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623014.714585:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858381056 00000100:00100000:3.0:1788623014.714600:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858381056 00000100:00100000:3.0:1788623014.714678:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 197 00000100:00100000:3.0:1788623014.714692:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+35:11546:x1875506858381056:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:3.0:1788623014.714726:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623014.714800:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d7450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea74 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.715112:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.715131:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.715146:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.715165:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.715174:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.715182:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.715956:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d7465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.715971:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d7465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716051:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d7465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623014.716067:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788623014.716194:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716202:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716210:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716217:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623014.716223:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716232:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716248:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623014.716251:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623014.716257:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.716263:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d7457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717183:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717193:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717214:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717219:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623014.717223:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717229:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717243:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11ed0700) 00010000:00010000:2.0:1788623014.717246:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623014.717250:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717256:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d745e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717324:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d7450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea74 expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717342:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d7465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea74 expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.717350:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:2.0:1788623014.717352:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623014.717356:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788623014.717458:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:11546:x1875506858381056:12345-192.168.204.19@tcp:101:cat.0 Request processed in 2767us (3091us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788623014.717477:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 197 00000100:00100000:2.0:1788623014.724541:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623014.724714:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858381312 00000100:00100000:0.0:1788623014.724728:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858381312 00000100:00100000:1.0:1788623014.725082:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 54 00000100:00100000:1.0:1788623014.725098:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:11546:x1875506858381312:12345-192.168.204.19@tcp:35:cat.0 00000100:00100000:1.0:1788623014.725438:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:11546:x1875506858381312:12345-192.168.204.19@tcp:35:cat.0 Request processed in 344us (908us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788623014.725447:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 54 00000100:00100000:0.0:1788623014.765934:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.766149:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858381568 00000100:00100000:1.0:1788623014.766162:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858381568 00000100:00100000:1.0:1788623014.766238:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 198 00000100:00100000:1.0:1788623014.766251:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:11547:x1875506858381568:12345-192.168.204.19@tcp:36:rm.0 00010000:00010000:1.0:1788623014.766400:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788623014.766574:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d7465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea74 expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.766628:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d743b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea6d expref: 37 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.766644:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d7403 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea5f expref: 36 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.766657:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e05312000) 00010000:00010000:1.0:1788623014.766674:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788623014.768542:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.768587:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.768604:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.768630:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.768638:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.768644:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.769032:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.769043:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.769061:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788623014.770096:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788623014.770110:0:6676:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338725367132ns, next at 339725363972ns, rc = 0 00010000:00010000:1.0:1788623014.770197:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.770211:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.770222:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.770231:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.770238:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.770245:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.770986:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623014.771023:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771032:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771040:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771058:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.771064:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771073:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771090:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11991800) 00010000:00010000:1.0:1788623014.771093:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788623014.771099:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771106:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7481 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771132:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771138:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771143:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771148:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dbc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.771151:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771156:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771176:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623014.771178:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.771182:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.771188:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7473 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623014.771199:0:6676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003deccdb7 reply state 0000000094b716b7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.771208:0:6676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788623014.771547:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623014.771557:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.771564:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623014.771577:0:7601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.771584:0:7601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.771595:0:7601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff997e11991800) 00010000:00010000:3.0:1788623014.771597:0:7601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788623014.771608:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.771614:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da800/0xef842f43731d7488 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.771634:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623014.771636:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623014.771638:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623014.771795:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+37:11547:x1875506858381568:12345-192.168.204.19@tcp:36:rm.0 Request processed in 5540us (5866us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788623014.771866:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 198 00010000:00010000:3.0:1788623014.777253:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.777284:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.777293:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.777299:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623014.777305:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.777314:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.777338:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991b00) 00010000:00010000:3.0:1788623014.777341:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623014.777347:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.777354:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d747a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.828183:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623014.849106:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.849303:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858381824 00000100:00100000:1.0:1788623014.849317:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858381824 00000100:00100000:1.0:1788623014.849398:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 199 00000100:00100000:1.0:1788623014.849412:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+36:11553:x1875506858381824:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788623014.849453:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623014.849481:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d748f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea7b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.849657:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.849676:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.849711:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.849728:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.849735:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.849776:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788623014.851374:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788623014.852094:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852114:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852127:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852175:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852184:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852192:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852198:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623014.852217:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852226:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852241:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623014.852244:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623014.852249:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852257:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7496 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623014.852284:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ac7b083 reply state 000000004dc10cfd transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623014.852295:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788623014.852339:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d748f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852355:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623014.852363:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:1.0:1788623014.852366:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788623014.852368:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dbe00, rc 0) 00000100:00100000:1.0:1788623014.852470:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11553:x1875506858381824:12345-192.168.204.19@tcp:101:bash.0 Request processed in 3060us (3377us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788623014.852479:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 199 00000100:00100000:2.0:1788623014.858314:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623014.858397:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858381952 00000100:00100000:0.0:1788623014.858410:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858381952 00000100:00100000:0.0:1788623014.858649:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:0.0:1788623014.858665:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858381952:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788623014.858688:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623014.858713:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea82 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788623014.858765:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623014.858816:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1788623014.858822:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623014.858833:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.858859:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623014.858875:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8400, rc 0) 00000100:00100000:0.0:1788623014.858945:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2351:x1875506858381952:12345-192.168.204.19@tcp:101:bash.0 Request processed in 284us (641us total) trans 0 rc 0/0 00000100:00080000:2.0:1788623014.859000:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788623014.859366:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.859377:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.859385:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.859392:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dae00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623014.859398:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.859407:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.859426:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991500) 00010000:00010000:3.0:1788623014.859430:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623014.859444:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623014.859451:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d749d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623014.860941:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:0.0:1788623014.867091:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623014.867206:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858382080 00000100:00100000:2.0:1788623014.867220:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858382080 00000100:00100000:2.0:1788623014.867300:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:2.0:1788623014.867312:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:11553:x1875506858382080:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788623014.867336:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623014.867361:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea89 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.867402:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.867412:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623014.867417:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623014.867423:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 7 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.867480:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.867497:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623014.868124:0:6655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6655:1875506866761472:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623014.868251:0:6655:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623014.871252:0:6655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6655:1875506866761472:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623014.871359:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 7 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.871384:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623014.871521:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:11553:x1875506858382080:12345-192.168.204.19@tcp:101:bash.0 Request processed in 4210us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623014.871532:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:0.0:1788623014.874255:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623014.874942:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858382208 00000100:00100000:2.0:1788623014.874958:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858382208 00010000:00010000:2.0:1788623014.875080:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623014.875372:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 74 00000100:00100000:2.0:1788623014.875385:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858382208:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788623014.875406:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623014.875448:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.875467:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.875528:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ca3d096/0xef842f43731d74b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea82 expref: 7 pid: 6656 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.875549:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623014.875554:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623014.875574:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 6 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.875587:0:7602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 6 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623014.875636:0:7602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 6 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623014.875668:0:7602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef02d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7602:1875506866761600:192.168.204.19@tcp:105: 00000100:00100000:2.0:1788623014.875827:0:7602:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623014.879412:0:7602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef02d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7602:1875506866761600:192.168.204.19@tcp:105: 00010000:00010000:2.0:1788623014.879461:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623014.879667:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2348:x1875506858382208:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 4281us (5421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623014.879681:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 74 00000100:00100000:2.0:1788623014.882455:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623014.882630:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858382464 00000100:00100000:1.0:1788623014.882644:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858382464 00000100:00100000:1.0:1788623014.882718:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00100000:1.0:1788623014.882730:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+38:11553:x1875506858382464:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:1.0:1788623014.883249:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11553:x1875506858382464:12345-192.168.204.19@tcp:35:bash.0 Request processed in 519us (805us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788623014.883259:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 55 00000100:00100000:0.0:1788623015.102701:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623015.102832:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858382592 00000100:00100000:3.0:1788623015.102847:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858382592 00000100:00100000:3.0:1788623015.102923:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 200 00000100:00100000:3.0:1788623015.102935:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+39:11569:x1875506858382592:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623015.102965:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623015.103007:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d74c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea90 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.103112:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d74c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.103130:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d74c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.103148:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d74c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623015.103197:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788623015.103201:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788623015.103224:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d74c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.103256:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d74c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea90 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.103289:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d74c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea90 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.103299:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623015.103302:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788623015.103306:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734800, rc 0) 00000100:00100000:3.0:1788623015.103540:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+40:11569:x1875506858382592:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 606us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623015.103549:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 200 00000100:00100000:2.0:1788623015.109764:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.109915:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858382848 00000100:00100000:1.0:1788623015.109929:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858382848 00000100:00100000:1.0:1788623015.110002:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 201 00000100:00100000:1.0:1788623015.110015:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+40:11569:x1875506858382848:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788623015.110043:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623015.110070:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea97 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.110204:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d74d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.110222:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d74d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.110237:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d74d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623015.110250:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788623015.110623:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea97 expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.110643:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d74d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea97 expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.110670:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:1.0:1788623015.110673:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788623015.110678:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0daa00, rc 0) 00000100:00100000:1.0:1788623015.110847:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+42:11569:x1875506858382848:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 833us (1114us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788623015.110856:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 201 00000100:00100000:2.0:1788623015.122080:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623015.122155:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.122315:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858383232 00000100:00100000:1.0:1788623015.122329:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858383232 00000100:00100000:1.0:1788623015.122482:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:1.0:1788623015.122495:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+42:2350:x1875506858383232:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623015.122515:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623015.122550:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d74d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea97 expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.122584:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:1.0:1788623015.122591:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623015.122654:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+41:2350:x1875506858383232:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 162us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623015.122663:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:3.0:1788623015.123246:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858383104 00000100:00100000:3.0:1788623015.123314:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858383104 00000100:00100000:3.0:1788623015.123358:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 202 00000100:00100000:3.0:1788623015.123368:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+41:11569:x1875506858383104:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:3.0:1788623015.123459:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623015.123483:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d74e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ea9e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.123620:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d74ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.123640:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d74ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.123653:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d74ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623015.123667:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788623015.124484:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d74e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea9e expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.124510:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d74ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea9e expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.124520:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:3.0:1788623015.124523:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788623015.124526:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734200, rc 0) 00000100:00100000:3.0:1788623015.124597:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+43:11569:x1875506858383104:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1230us (2529us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788623015.124605:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 202 00000100:00100000:0.0:1788623015.132488:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.132589:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858383360 00000100:00100000:1.0:1788623015.132604:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858383360 00000100:00100000:1.0:1788623015.132682:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:1.0:1788623015.132694:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+6:2349:x1875506858383360:12345-192.168.204.19@tcp:1:lfs.0 00010000:00010000:1.0:1788623015.132789:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.132842:0:6657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 6 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.132852:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788623015.132857:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788623015.132862:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.132914:0:6657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 6 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.132931:0:6657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 6 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623015.132950:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6657:1875506866761728:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623015.133069:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623015.136942:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623015.137030:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858383488 00000100:00100000:3.0:1788623015.137045:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858383488 00002000:00100000:3.0:1788623015.137116:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff997e2ef01880 x1875506858383488/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:91/0 lens 504/0 e 0 to 0 dl 1788623026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788623015.137128:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e2ef01880 with x1875506858383488 ext(0->8) 00010000:00010000:3.0:1788623015.137139:0:6660:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 7 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.137158:0:6660:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 7 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788623015.137166:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997e2ef01880 00000100:00100000:3.0:1788623015.137206:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:3.0:1788623015.137217:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858383488:12345-192.168.204.19@tcp:4:lfs.0 00000100:00100000:3.0:1788623015.137939:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858383488:12345-192.168.204.19@tcp:4:lfs.0 Request processed in 720us (1007us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788623015.137948:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 3 00002000:00100000:3.0:1788623015.137957:0:6660:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff997e2ef01880 x1875506858383488/t4294967308(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:91/0 lens 504/448 e 0 to 0 dl 1788623026 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788623015.137967:0:6660:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e2ef01880 with x1875506858383488 ext(0->8) 00010000:00010000:3.0:1788623015.137975:0:6660:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 9 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.137991:0:6660:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 9 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788623015.138011:0:6660:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff997e2ef01880 00000100:00100000:1.0:1788623015.138832:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6657:1875506866761728:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623015.138871:0:6657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623015.140957:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623015.141089:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858383616 00000100:00100000:3.0:1788623015.141101:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858383616 00010000:00010000:3.0:1788623015.141153:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 9 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623015.141206:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 75 00000100:00100000:3.0:1788623015.141218:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2349:x1875506858383616:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623015.141238:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788623015.141274:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788623015.141278:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788623015 00002000:00010000:3.0:1788623015.141280:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788623015 00002000:00010000:3.0:1788623015.141283:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788623015 00010000:00010000:3.0:1788623015.141292:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 9 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.141309:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 9 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.141341:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8eb251/0xef842f43731d74b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea89 expref: 9 pid: 6655 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.141364:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623015.141369:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623015.141477:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.141506:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.141547:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623015.141661:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2349:x1875506858383616:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 444us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623015.141670:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 75 00010000:00010000:1.0:1788623015.141950:0:6657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.141962:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142002:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142011:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142020:0:6657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142028:0:6657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0daa00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623015.142033:0:6657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142044:0:6657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142058:0:6657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.142066:0:6657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d74f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623015.142122:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858383360:12345-192.168.204.19@tcp:1:lfs.0 Request processed in 9430us (9647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623015.142131:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:0.0:1788623015.145462:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.145570:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858383872 00000100:00100000:1.0:1788623015.145583:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858383872 00000100:00100000:1.0:1788623015.145683:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 56 00000100:00100000:1.0:1788623015.145695:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+43:11569:x1875506858383872:12345-192.168.204.19@tcp:35:lfs.0 00000004:00010000:1.0:1788623015.145814:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d74ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea9e expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788623015.146118:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788623015.146159:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788623015.147026:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1788623015.147104:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.147123:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.147135:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.147180:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.147199:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 47 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623015.147217:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5812:1875506866761856:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623015.147534:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548180 going to sleep for 11 seconds 00000100:00100000:2.0:1788623015.152248:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623015.152326:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858384000 00000100:00100000:3.0:1788623015.152339:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858384000 00010000:00010000:3.0:1788623015.152402:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 48 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623015.152451:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:3.0:1788623015.152465:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+48:2348:x1875506858384000:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623015.152485:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623015.152493:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 48 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.152509:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 48 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.152538:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:3.0:1788623015.152545:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.152568:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.152604:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623015.152631:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623015.152697:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+48:2348:x1875506858384000:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 236us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623015.152706:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 76 00010000:00010000:1.0:1788623015.155333:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d74a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea7b expref: 47 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623015.155443:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5812:1875506866761856:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623015.155478:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.155490:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.155497:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788623015.155694:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788623015.158481:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788623015.158702:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866761984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788623015.158947:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623015.159045:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623015.159090:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866761984 00000100:00100000:0.0:1788623015.159101:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866761984 00000100:00100000:0.0:1788623015.159233:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788623015.159245:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866761984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788623015.159362:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866761984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623015.159369:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788623015.159468:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866761984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788623015.160125:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788623015.160216:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866762112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788623015.160266:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623015.160303:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548180 going to sleep for 11 seconds 00000100:00100000:0.0:1788623015.160527:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866762112 00000100:00100000:0.0:1788623015.160535:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866762112 00000100:00100000:0.0:1788623015.160581:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788623015.160602:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875506866762112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788623015.160846:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1875506866762112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 245us (578us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788623015.160854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788623015.161137:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a009f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5812:1875506866762112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788623015.161204:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788623015.161268:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.161280:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.161297:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.161303:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623015.161309:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.161318:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.161338:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:1.0:1788623015.161341:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788623015.161348:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.161355:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d74ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788623015.161597:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788623015.161781:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788623015.161922:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339117178996ns, next at 340117175406ns, rc = 0 00000001:00080000:1.0:1788623015.161932:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788623015.161981:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e11991700) 00010000:00010000:1.0:1788623015.161984:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788623015.161992:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d74ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea9e expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623015.162142:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:11569:x1875506858383872:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 16448us (16690us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788623015.162165:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 56 00000020:00080000:1.0:1788623015.162171:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788623015.165151:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.165267:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858384128 00000100:00100000:0.0:1788623015.165280:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858384128 00000100:00100000:0.0:1788623015.165354:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 203 00000100:00100000:0.0:1788623015.165366:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+50:11569:x1875506858384128:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623015.165500:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623015.165530:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eaa5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.165618:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaa5 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.165636:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaa5 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.165658:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623015.165662:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788623015.165667:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8800, rc 0) 00000100:00100000:0.0:1788623015.165821:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:11569:x1875506858384128:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 455us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623015.165828:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 203 00000100:00080000:2.0:1788623015.166070:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788623015.170126:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.170232:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858384384 00000100:00100000:0.0:1788623015.170245:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858384384 00000100:00100000:0.0:1788623015.170465:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:0.0:1788623015.170498:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+51:11569:x1875506858384384:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788623015.171006:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:11569:x1875506858384384:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 509us (889us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788623015.171017:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 57 00000100:00100000:2.0:1788623015.270539:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623015.277672:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858384512 00000100:00100000:3.0:1788623015.277700:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858384512 00000100:00100000:2.0:1788623015.284711:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 204 00000100:00100000:2.0:1788623015.284729:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:11579:x1875506858384512:12345-192.168.204.19@tcp:34:lfs.0 00010000:00010000:2.0:1788623015.284858:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.284879:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.284895:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.284913:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.284920:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.284928:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285038:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285047:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285074:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788623015.285130:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285145:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285152:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285160:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285166:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623015.285172:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285181:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285194:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623015.285197:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623015.285203:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285210:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d750d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285226:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285237:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285244:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285249:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623015.285252:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285450:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285460:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e07097b00) 00010000:00010000:2.0:1788623015.285463:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623015.285466:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285473:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285490:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285497:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285503:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285508:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08baca00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623015.285516:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285523:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285530:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623015.285532:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623015.285535:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.285541:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d751b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623015.286679:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:11579:x1875506858384512:12345-192.168.204.19@tcp:34:lfs.0 Request processed in 1947us (16144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623015.286692:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 204 00000100:00100000:3.0:1788623015.377571:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.377693:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858384768 00000100:00100000:0.0:1788623015.377706:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858384768 00000100:00100000:0.0:1788623015.377813:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 205 00000100:00100000:0.0:1788623015.377826:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+52:11582:x1875506858384768:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623015.377854:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623015.377884:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d7522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eaac expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.377984:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378004:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378020:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378037:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378045:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378051:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378227:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d7537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378236:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378244:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623015.378255:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788623015.378387:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378396:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378403:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378409:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623015.378415:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378423:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378437:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788623015.378441:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623015.378447:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378465:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378481:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378487:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378493:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378499:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623015.378502:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378507:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378515:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e05312900) 00010000:00010000:0.0:1788623015.378518:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623015.378521:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378526:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d7530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378591:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d7522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaac expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378607:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d7537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaac expref: 54 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.378621:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623015.378624:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623015.378627:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9e00, rc 0) 00000100:00100000:0.0:1788623015.379311:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11582:x1875506858384768:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1482us (1759us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788623015.379323:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 205 00000100:00100000:3.0:1788623015.384150:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.387946:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858384896 00000100:00100000:1.0:1788623015.387963:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858384896 00000100:00100000:1.0:1788623015.388101:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 206 00000100:00100000:1.0:1788623015.388113:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11582:x1875506858384896:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:1.0:1788623015.388221:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388244:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388265:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388300:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388308:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388316:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388322:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623015.388327:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388336:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388374:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:1.0:1788623015.388378:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788623015.388384:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.388392:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7545 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623015.388487:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11582:x1875506858384896:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 376us (4350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623015.388495:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 206 00000100:00100000:3.0:1788623015.393624:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.393720:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858385152 00000100:00100000:0.0:1788623015.393733:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858385152 00000100:00100000:0.0:1788623015.393812:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 58 00000100:00100000:0.0:1788623015.393823:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+54:11582:x1875506858385152:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:0.0:1788623015.394122:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:11582:x1875506858385152:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 300us (507us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788623015.394130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 58 00000100:00100000:3.0:1788623015.492805:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.493309:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858385408 00000100:00100000:1.0:1788623015.493323:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858385408 00000100:00100000:1.0:1788623015.493394:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 207 00000100:00100000:1.0:1788623015.493407:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+55:11592:x1875506858385408:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788623015.493438:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623015.493442:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788623015.493477:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d74c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea90 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.493502:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623015.493509:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788623015.493537:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d754c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eab3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.493680:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.493717:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.493730:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623015.493808:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788623015.493982:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d754c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eab3 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.494000:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eab3 expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.494009:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:1.0:1788623015.494012:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788623015.494015:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dbe00, rc 0) 00000100:00100000:1.0:1788623015.494104:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11592:x1875506858385408:12345-192.168.204.19@tcp:101:bash.0 Request processed in 698us (1320us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788623015.494112:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 207 00000100:00100000:3.0:1788623015.502238:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623015.502396:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858385664 00000100:00100000:2.0:1788623015.502410:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858385664 00000100:00100000:2.0:1788623015.502523:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 208 00000100:00100000:2.0:1788623015.502536:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11592:x1875506858385664:12345-192.168.204.19@tcp:36:bash.0 00010000:00010000:2.0:1788623015.502628:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788623015.502665:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eab3 expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.502694:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9e00/0xef842f43731d7537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaac expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.502708:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623015.502731:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788623015.503083:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.503104:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.503117:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788623015.503249:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1788623015.503278:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074776ca9 reply state 00000000e6e7becf transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623015.503288:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788623015.503469:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11592:x1875506858385664:12345-192.168.204.19@tcp:36:bash.0 Request processed in 934us (1323us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788623015.503476:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 208 00000020:00080000:2.0:1788623015.503482:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788623015.507652:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.507673:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.507682:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.507688:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623015.507695:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.507704:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.507852:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623015.507856:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623015.507863:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.507910:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d7561 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623015.511494:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.511603:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858385792 00000100:00100000:1.0:1788623015.511627:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858385792 00000100:00100000:1.0:1788623015.511708:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 209 00000100:00100000:1.0:1788623015.511721:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+56:11592:x1875506858385792:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:1.0:1788623015.511796:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623015.511828:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7568 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eaba expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.511977:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.511996:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.512010:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623015.512046:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788623015.512051:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623015.512076:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.512288:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7568 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 58 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.512311:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.512321:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:1.0:1788623015.512324:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788623015.512329:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0daa00, rc 0) 00000100:00100000:1.0:1788623015.512506:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e371e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11592:x1875506858385792:12345-192.168.204.19@tcp:101:bash.0 Request processed in 787us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623015.512514:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 209 00000100:00100000:3.0:1788623015.516384:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.516633:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858386048 00000100:00100000:0.0:1788623015.516646:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858386048 00000100:00100000:0.0:1788623015.516719:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:0.0:1788623015.516731:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3b008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+57:11592:x1875506858386048:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:0.0:1788623015.517097:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3b008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11592:x1875506858386048:12345-192.168.204.19@tcp:35:bash.0 Request processed in 367us (724us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788623015.517107:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 59 00000100:00100000:3.0:1788623015.593623:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623015.594058:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858386176 00000100:00100000:1.0:1788623015.594074:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858386176 00000100:00100000:1.0:1788623015.594183:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 210 00000100:00100000:1.0:1788623015.594197:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+58:11598:x1875506858386176:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788623015.594232:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623015.594274:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eac1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.594370:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d757d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.594387:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d757d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.594402:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d757d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623015.594449:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788623015.594454:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623015.594476:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d757d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.594505:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db600/0xef842f43731d7576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac1 expref: 60 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.594526:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d757d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac1 expref: 59 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623015.594535:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:1.0:1788623015.594538:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788623015.594542:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da000, rc 0) 00000100:00100000:1.0:1788623015.594630:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11598:x1875506858386176:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 436us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623015.594648:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 210 00000100:00100000:1.0:1788623015.603694:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.603937:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858386304 00000100:00100000:0.0:1788623015.603952:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858386304 00000100:00100000:0.0:1788623015.604070:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 211 00000100:00100000:0.0:1788623015.604084:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11598:x1875506858386304:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623015.604148:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623015.604179:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d7584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eac8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604280:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604301:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604315:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604332:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604340:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604346:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604461:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604471:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604478:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623015.604523:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788623015.604534:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623015.604594:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604610:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604620:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604628:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604636:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604643:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623015.604648:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604657:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604674:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788623015.604677:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623015.604684:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604692:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d758b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604709:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604725:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604732:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.604737:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623015.605413:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.605428:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.605440:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e05312900) 00010000:00010000:0.0:1788623015.605443:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623015.605447:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.605453:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d7592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.605504:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d7584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.605520:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.605528:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623015.605530:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623015.605546:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9000, rc 0) 00000100:00100000:0.0:1788623015.605655:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11598:x1875506858386304:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1571us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623015.605663:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 211 00000100:00100000:3.0:1788623015.609236:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623015.609598:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858386560 00000100:00100000:2.0:1788623015.609619:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858386560 00000100:00100000:2.0:1788623015.609697:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 212 00000100:00100000:2.0:1788623015.609709:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11598:x1875506858386560:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623015.609735:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623015.609789:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eacf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.609937:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.609955:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.609965:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.609975:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.610019:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.610055:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623015.610071:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef02300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866762240:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623015.610200:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.610210:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623015.610220:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866762368:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623015.610247:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623015.613434:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:2.0:1788623015.613638:0:5811:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.19@tcp) returned -22 from blocking AST (req@0000000050c2aeeb x1875506866762240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.613956:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.613990:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9000/0xef842f43731d7599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac8 expref: 61 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623015.614012:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef02300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866762240:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623015.614034:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866762368:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623015.614064:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623015.614090:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.614100:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.614110:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623015.614682:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858386816 00000100:00100000:0.0:1788623015.614693:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858386816 00010000:00010000:0.0:1788623015.614763:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623015.614826:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:0.0:1788623015.614837:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:2349:x1875506858386816:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623015.614857:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623015.614864:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.614877:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.614894:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0daa00/0xef842f43731d756f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaba expref: 61 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.614908:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623015.614912:0:7602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.614921:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.614929:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.614981:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623015.615056:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:2349:x1875506858386816:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 220us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623015.615065:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 77 00010000:00010000:2.0:1788623015.615770:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.615783:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623015.615814:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:3.0:1788623015.615920:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:2.0:1788623015.616091:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.616113:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.616123:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623015.616125:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788623015.616128:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad200, rc 0) 00000100:00100000:2.0:1788623015.616174:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11598:x1875506858386560:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 6467us (6950us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788623015.616182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 212 00000100:00100000:0.0:1788623015.617448:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858386688 00000100:00100000:0.0:1788623015.617462:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858386688 00000100:00100000:0.0:1788623015.617531:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:0.0:1788623015.617542:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:2351:x1875506858386688:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623015.617570:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623015.617574:0:5796:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ef842f43731d7599) 00010000:00010000:0.0:1788623015.617576:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623015.617629:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:2351:x1875506858386688:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 89us (1711us total) trans 0 rc 116/116 00000100:00100000:0.0:1788623015.617636:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:3.0:1788623015.621340:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.621563:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387072 00000100:00100000:0.0:1788623015.621575:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387072 00000100:00100000:0.0:1788623015.621649:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788623015.621661:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11598:x1875506858387072:12345-192.168.204.19@tcp:103:lfs.0 00010000:00010000:0.0:1788623015.621680:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623015.621712:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8800/0xef842f43731d7506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaa5 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.621735:0:7602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623015.621760:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623015.621832:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11598:x1875506858387072:12345-192.168.204.19@tcp:103:lfs.0 Request processed in 174us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623015.621857:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788623015.624042:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623015.624125:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387200 00000100:00100000:2.0:1788623015.624147:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387200 00000100:00100000:2.0:1788623015.624226:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 213 00000100:00100000:2.0:1788623015.624237:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11598:x1875506858387200:12345-192.168.204.19@tcp:58:lfs.0 00010000:00010000:2.0:1788623015.624391:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.624412:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623015.624426:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788623015.624684:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788623015.624820:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11598:x1875506858387200:12345-192.168.204.19@tcp:58:lfs.0 Request processed in 584us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623015.624828:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 213 00000100:00100000:3.0:1788623015.627275:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623015.627641:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387328 00000100:00100000:0.0:1788623015.627653:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387328 00000100:00100000:0.0:1788623015.627719:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 214 00000100:00100000:0.0:1788623015.627731:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+59:11598:x1875506858387328:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623015.627780:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623015.627904:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ead6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.627987:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.628001:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.628025:0:5809:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.628040:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.628058:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623015.628062:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788623015.628065:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623015.628074:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8a00, rc 0) 00000100:00100000:0.0:1788623015.628569:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11598:x1875506858387328:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 838us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623015.628579:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 214 00010000:00010000:3.0:1788623015.852534:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788623016.300310:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788623016.300321:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788623016.300366:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788623016.300374:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788623016.300667:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f169180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866762496:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788623016.300830:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e012eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788623016.308623:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f169180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866762496:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788623016.309634:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.309895:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387456 00000100:00100000:2.0:1788623016.309906:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387456 00000100:00100000:2.0:1788623016.309997:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 215 00000100:00100000:2.0:1788623016.310008:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11599:x1875506858387456:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788623016.310051:0:5810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788623016.310202:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11599:x1875506858387456:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 195us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.310211:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 215 00000100:00080000:3.0:1788623016.310349:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623016.316886:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623016.317917:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387584 00000100:00100000:0.0:1788623016.317933:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387584 00000100:00100000:0.0:1788623016.318016:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 216 00000100:00100000:0.0:1788623016.318028:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11599:x1875506858387584:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788623016.318144:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318168:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318187:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318205:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318214:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318220:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318247:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318255:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318281:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623016.318332:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788623016.318337:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623016.318352:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318368:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318375:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318383:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318390:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623016.318395:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318404:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318419:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:0.0:1788623016.318423:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623016.318428:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318436:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8200/0xef842f43731d75c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318463:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318470:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318476:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318482:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623016.318485:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318492:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318500:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff997e05312900) 00010000:00010000:0.0:1788623016.318503:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623016.318506:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318512:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9800/0xef842f43731d75ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318530:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318547:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318553:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318565:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623016.318568:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318576:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318584:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623016.318587:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623016.318590:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.318596:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8000/0xef842f43731d75d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.318701:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11599:x1875506858387584:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 Request processed in 673us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.318710:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 216 00000100:00100000:0.0:1788623016.327887:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.328023:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387840 00000100:00100000:2.0:1788623016.328037:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387840 00000100:00100000:2.0:1788623016.328111:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 217 00000100:00100000:2.0:1788623016.328124:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+60:11599:x1875506858387840:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.328150:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623016.328195:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d75d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eadd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328328:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328347:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328362:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623016.328375:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788623016.328508:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328517:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328524:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328530:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.328546:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328555:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328570:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623016.328573:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788623016.328580:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328598:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d75df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328654:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d75d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eadd expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328665:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:2.0:1788623016.328668:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623016.328672:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d75d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eadd expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.328681:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08bad000, rc 0) 00000100:00100000:2.0:1788623016.328782:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11599:x1875506858387840:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 660us (908us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1788623016.328790:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 217 00000100:00100000:1.0:1788623016.331587:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623016.331695:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858387968 00000100:00100000:0.0:1788623016.331708:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858387968 00000100:00100000:0.0:1788623016.331830:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 218 00000100:00100000:0.0:1788623016.331843:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11599:x1875506858387968:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788623016.331893:0:5809:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788623016.332034:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11599:x1875506858387968:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 193us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.332044:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 218 00000100:00100000:3.0:1788623016.335167:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.335236:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858388224 00000100:00100000:2.0:1788623016.335250:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858388224 00000100:00100000:2.0:1788623016.335329:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 219 00000100:00100000:2.0:1788623016.335341:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11599:x1875506858388224:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.335370:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623016.335374:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788623016.335408:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d757d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eac1 expref: 61 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.335434:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623016.335441:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788623016.335475:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d75ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eae4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788623016.336454:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788623016.339401:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d75f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.339430:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d75f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.339446:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d75f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.339554:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad600/0xef842f43731d75ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eae4 expref: 63 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.339582:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d75f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eae4 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.339592:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097b00) 00010000:00010000:2.0:1788623016.339595:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623016.339600:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e08baca00, rc 0) 00000100:00100000:2.0:1788623016.339703:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11599:x1875506858388224:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 4363us (4548us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788623016.339713:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 219 00000100:00100000:3.0:1788623016.345373:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.345586:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858388480 00000100:00100000:2.0:1788623016.345600:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858388480 00000100:00100000:2.0:1788623016.345678:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 220 00000100:00100000:2.0:1788623016.345690:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11599:x1875506858388480:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.345811:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623016.345847:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08baca00/0xef842f43731d75f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eae4 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.345873:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097b00) 00010000:00010000:2.0:1788623016.345887:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788623016.345916:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.345934:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.345946:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.345962:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.345968:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.345975:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346054:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346063:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346070:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346084:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.346090:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346099:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346108:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:2.0:1788623016.346111:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623016.346115:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346121:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad000/0xef842f43731d7602 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346132:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346138:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346144:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346149:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bad400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.346151:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346163:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346181:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x250b373 (ffff997e07097a00) 00010000:00010000:2.0:1788623016.346184:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623016.346187:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.346193:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad400/0xef842f43731d7609 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x250b373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.346297:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11599:x1875506858388480:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 607us (937us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788623016.346304:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 220 00000100:00100000:1.0:1788623016.348809:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.348863:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858388608 00000100:00100000:2.0:1788623016.348877:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858388608 00000100:00100000:2.0:1788623016.348946:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 221 00000100:00100000:2.0:1788623016.348957:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+61:11599:x1875506858388608:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.348980:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623016.349032:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb800/0xef842f43731d7610 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eaeb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.349094:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.349111:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.349125:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.349245:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb800/0xef842f43731d7610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 63 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.349275:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 62 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.349286:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:2.0:1788623016.349289:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788623016.349293:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372faa00, rc 0) 00000100:00100000:2.0:1788623016.349365:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11599:x1875506858388608:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 410us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.349371:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 221 00000100:00100000:3.0:1788623016.352146:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.352204:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858388864 00000100:00100000:2.0:1788623016.352216:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858388864 00000100:00100000:2.0:1788623016.352298:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 222 00000100:00100000:2.0:1788623016.352311:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+62:11599:x1875506858388864:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.352422:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.352524:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.352551:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788623016.353121:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788623016.353133:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340308390409ns, next at 341308387187ns, rc = 0 00000004:00010000:2.0:1788623016.353247:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b13f62d reply state 000000008febf3fe transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.353282:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788623016.353417:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+64:11599:x1875506858388864:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1106us (1283us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788623016.353427:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 222 00010000:00010000:1.0:1788623016.359604:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.359626:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.359647:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.359654:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fba00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623016.359660:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.359671:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.359701:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:1.0:1788623016.359723:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788623016.359730:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.359737:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fba00/0xef842f43731d761e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.361925:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.362030:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858388992 00000100:00100000:1.0:1788623016.362044:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858388992 00000100:00100000:1.0:1788623016.362231:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 223 00000100:00100000:1.0:1788623016.362245:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+63:11599:x1875506858388992:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623016.362282:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623016.362310:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eaf2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.362394:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 64 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.362412:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 64 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.362436:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:1.0:1788623016.362440:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788623016.362444:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dbc00, rc 0) 00000100:00100000:1.0:1788623016.362579:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+64:11599:x1875506858388992:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 337us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623016.362588:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 223 00000100:00100000:3.0:1788623016.376900:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623016.377181:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858389120 00000100:00100000:0.0:1788623016.377216:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858389120 00000100:00100000:0.0:1788623016.377316:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 62 00000100:00100000:0.0:1788623016.377330:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858389120:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788623016.378019:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788623016.378912:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2348:x1875506858389120:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 1578us (2018us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788623016.378944:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 62 00000100:00100000:0.0:1788623016.386276:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.386396:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858389376 00000100:00100000:1.0:1788623016.386411:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858389376 00000100:00100000:1.0:1788623016.386486:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:1.0:1788623016.386498:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+64:11599:x1875506858389376:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788623016.387172:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+65:11599:x1875506858389376:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 558us (791us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788623016.387183:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 60 00000100:00100000:3.0:1788623016.389984:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.390097:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858389632 00000100:00100000:1.0:1788623016.390111:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858389632 00000100:00100000:1.0:1788623016.390186:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 224 00000100:00100000:1.0:1788623016.390199:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+65:11599:x1875506858389632:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788623016.390350:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+65:11599:x1875506858389632:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 152us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623016.390359:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 224 00000100:00100000:3.0:1788623016.395376:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.395640:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858389760 00000100:00100000:1.0:1788623016.395655:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858389760 00000100:00100000:1.0:1788623016.396193:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 225 00000100:00100000:1.0:1788623016.396207:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+65:11599:x1875506858389760:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623016.396235:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623016.396263:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d762c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eaf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.396355:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.396396:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.396411:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623016.396460:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623016.396485:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.397174:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dae00/0xef842f43731d762c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf9 expref: 67 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.397201:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf9 expref: 66 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.397212:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:1.0:1788623016.397215:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788623016.397220:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da400, rc 0) 00000100:00100000:1.0:1788623016.397319:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+66:11599:x1875506858389760:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 1114us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623016.397328:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 225 00000100:00100000:0.0:1788623016.407696:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.409187:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858389888 00000100:00100000:2.0:1788623016.409203:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858389888 00000100:00100000:2.0:1788623016.409285:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:2.0:1788623016.409297:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+10:2349:x1875506858389888:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.409321:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623016.409413:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb00 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788623016.409448:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c38a8, blocks: 0x1 00010000:00010000:2.0:1788623016.409472:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788623016.409477:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623016.409488:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 11 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.409512:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 11 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.409529:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fb800, rc 0) 00000100:00100000:2.0:1788623016.410302:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2349:x1875506858389888:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 1003us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.410312:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:3.0:1788623016.413351:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.413446:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390144 00000100:00100000:1.0:1788623016.413461:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390144 00000100:00100000:1.0:1788623016.413560:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 226 00000100:00100000:1.0:1788623016.413573:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+66:11599:x1875506858390144:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788623016.413732:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+66:11599:x1875506858390144:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623016.413789:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 226 00000100:00100000:0.0:1788623016.423929:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.424039:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390272 00000100:00100000:2.0:1788623016.424063:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390272 00000100:00100000:2.0:1788623016.424143:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 64 00000100:00100000:2.0:1788623016.424155:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:11599:x1875506858390272:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.424181:0:6655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623016.424208:0:6655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb07 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.424250:0:6655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 12 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.424262:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623016.424266:0:6655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623016.424273:0:6655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 12 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.424317:0:6655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 12 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.424334:0:6655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 12 pid: 6656 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.424350:0:6655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6655:1875506866762624:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623016.424469:0:6655:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623016.431207:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623016.431500:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390400 00000100:00100000:3.0:1788623016.431632:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390400 00010000:00010000:3.0:1788623016.431786:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 13 pid: 6656 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.431837:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:3.0:1788623016.431848:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2349:x1875506858390400:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623016.431868:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623016.431899:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 13 pid: 6656 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.431917:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 13 pid: 6656 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.431948:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623016.431954:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623016.431964:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 13 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.431976:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 13 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.432042:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 13 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.432070:0:5796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e36e60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5796:1875506866762752:192.168.204.19@tcp:105: 00000100:00100000:3.0:1788623016.432172:0:5796:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07f3f780 going to sleep for 11 seconds 00010000:00010000:2.0:1788623016.432818:0:6655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004abecdac/0xef842f43731d763a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb00 expref: 13 pid: 6656 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.432859:0:6655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6655:1875506866762624:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623016.432901:0:6655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 12 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.432915:0:6655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fbc00, rc 0) 00000100:00100000:2.0:1788623016.432954:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+12:11599:x1875506858390272:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 8802us (9038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.432963:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 64 00000100:00100000:3.0:1788623016.437307:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623016.437909:0:5796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e36e60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5796:1875506866762752:192.168.204.19@tcp:105: 00010000:00010000:0.0:1788623016.437943:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623016.438024:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2349:x1875506858390400:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 6176us (6828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.438037:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:2.0:1788623016.440843:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390528 00000100:00100000:2.0:1788623016.440860:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390528 00002000:00100000:2.0:1788623016.440941:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff997e36e60e00 x1875506858390528/t0(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:92/0 lens 504/0 e 0 to 0 dl 1788623027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788623016.440954:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e36e60e00 with x1875506858390528 ext(0->12) 00002000:00010000:2.0:1788623016.440961:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e36e60e00 00000100:00100000:2.0:1788623016.441000:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:2.0:1788623016.441012:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+11:2348:x1875506858390528:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788623016.442552:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2348:x1875506858390528:12345-192.168.204.19@tcp:4:lhsmtool_posix.0 Request processed in 1515us (5230us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788623016.442566:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00002000:00100000:2.0:1788623016.442580:0:6661:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff997e36e60e00 x1875506858390528/t4294967320(0) o4->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:92/0 lens 504/448 e 0 to 0 dl 1788623027 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788623016.442591:0:6661:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e36e60e00 with x1875506858390528 ext(0->12) 00002000:00010000:2.0:1788623016.442605:0:6661:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e36e60e00 00000100:00100000:3.0:1788623016.456433:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.456571:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390656 00000100:00100000:2.0:1788623016.456583:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390656 00000100:00100000:2.0:1788623016.456662:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 227 00000100:00100000:2.0:1788623016.456675:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+66:11599:x1875506858390656:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788623016.492787:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866762880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788623016.493727:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623016.494184:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866762880 00000100:00100000:3.0:1788623016.494196:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866762880 00000100:00100000:3.0:1788623016.494283:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788623016.494295:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866762880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788623016.494339:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788623016.495502:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866762880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1200us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623016.495516:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788623016.495812:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866762880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788623016.495848:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788623016.531650:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:1.0:1788623016.531696:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1788623016.531709:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788623016.531736:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e06548b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788623016.531770:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e08916e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e06548300 00000020:00080000:1.0:1788623016.531774:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e08916200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997d0544d400 00000004:00080000:1.0:1788623016.531813:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1788623016.532306:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866763008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788623016.532402:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788623016.532480:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788623016.532575:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866763136:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788623016.532629:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:1.0:1788623016.532684:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866763264:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1788623016.532737:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e011ca3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788623016.532762:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e08647b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e011cac00 00000020:00080000:1.0:1788623016.532765:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e08647200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997e2fe5c400 00000020:00080000:1.0:1788623016.532781:0:5831:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788623016.532791:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788623016.533010:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788623016.533430:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11599:x1875506858390656:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 Request processed in 76754us (77005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.533442:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 227 00000100:00100000:2.0:1788623016.533497:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623016.534112:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866763008 00000100:00100000:0.0:1788623016.534124:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866763008 00000100:00100000:1.0:1788623016.534674:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623016.535202:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866763264 00000100:00100000:0.0:1788623016.535211:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866763264 00000100:00100000:0.0:1788623016.535238:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866763136 00000100:00100000:0.0:1788623016.535241:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866763136 00000100:00100000:0.0:1788623016.535257:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788623016.535268:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866763008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788623016.535309:0:6657:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:3.0:1788623016.535368:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788623016.535379:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1875506866763264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788623016.535602:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788623016.535607:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788623017 00002000:00010000:3.0:1788623016.535609:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788623016.535612:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788623016 -> 1788623017 00002000:00010000:3.0:1788623016.535614:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788623016.535699:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3281:x1875506866763264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (2200us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788623016.535718:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788623016.535738:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788623016.535767:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1875506866763136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788623016.535779:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788623016.535795:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.535820:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 12 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.535831:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788623016.535836:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623016.535842:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.536147:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 12 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.536167:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 12 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.536186:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e36e60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866763392:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623016.536287:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e106fd6c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788623016.536470:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e39b4b800/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788623016.536479:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866763264:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788623016.536593:0:6657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c38a7, atime: 0x6a9c38a7, ctime: 0x6a9c38a7, blocks: 0x1 00010000:00010000:0.0:1788623016.536601:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.536611:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1788623016.536614:0:6657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623016.536630:0:6657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.536656:0:6657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.536670:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.536678:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.536707:0:6657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788623016.538580:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875506866763008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3305us (6170us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788623016.538594:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1788623016.538855:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e3a316a00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788623016.539164:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866763008:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788623016.539469:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623016.539482:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.539509:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623016.539516:0:7601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.539530:0:7601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.539568:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.539578:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b278eaee/0xef842f43731d7648 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.539608:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623016.539610:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623016.539612:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623016.540428:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623016.540614:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390784 00000100:00100000:3.0:1788623016.540625:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390784 00000100:00100000:3.0:1788623016.540721:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:3.0:1788623016.540733:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2348:x1875506858390784:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788623016.552079:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623016.552315:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e36e60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866763392:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623016.552352:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.553212:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858390912 00000100:00100000:0.0:1788623016.553224:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858390912 00010000:00010000:0.0:1788623016.553275:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 14 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.553514:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:0.0:1788623016.553526:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+14:2348:x1875506858390912:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623016.553555:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623016.553562:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 14 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.553593:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 14 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.553624:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c3ba59a/0xef842f43731d740a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea66 expref: 14 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.553651:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623016.553658:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623016.553666:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.553679:0:7602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.553716:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788623016.553773:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.553794:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.553807:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.553815:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.553846:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+13:2348:x1875506858390912:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 317us (1777us total) trans 0 rc 0/0 00010000:00010000:2.0:1788623016.553866:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788623016.554546:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 79 00010000:00010000:2.0:1788623016.554845:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623016.554855:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.554866:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623016.554871:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.554881:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.554901:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.554909:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6195b4/0xef842f43731d764f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.554932:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623016.554934:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623016.554935:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623016.555584:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3280:x1875506866763136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19814us (20906us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788623016.555595:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788623016.555664:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e3a317480/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788623016.555671:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866763136:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788623016.610918:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1788623016.610949:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788623016.610956:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1788623016.610968:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788623016.611301:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858390784:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 Request processed in 70495us (70805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.611317:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:2.0:1788623016.615643:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.615996:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858391168 00000100:00100000:1.0:1788623016.616009:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858391168 00000100:00100000:1.0:1788623016.616083:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 228 00000100:00100000:1.0:1788623016.616094:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11599:x1875506858391168:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788623016.616170:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623016.616557:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf9 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.616578:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:1.0:1788623016.616584:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788623016.616626:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.616644:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.616656:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623016.617228:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074c1ab8d reply state 0000000091c2cafe transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623016.617511:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788623016.617673:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:11599:x1875506858391168:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 1578us (2041us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788623016.617702:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 228 00010000:00010000:2.0:1788623016.620281:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.620301:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.620311:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.620317:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.620324:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.620333:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.620355:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:2.0:1788623016.620359:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623016.620364:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.620372:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d7656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.622498:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.622841:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858391296 00000100:00100000:1.0:1788623016.622855:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858391296 00000100:00100000:1.0:1788623016.622987:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:1.0:1788623016.623000:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858391296:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788623016.623275:0:6657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788623016.623279:0:6657:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788623017 -> 1788623016 00002000:00010000:1.0:1788623016.623282:0:6657:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788623015 00002000:00010000:1.0:1788623016.623284:0:6657:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788623017 -> 1788623016 00002000:00010000:1.0:1788623016.623287:0:6657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788623016.623542:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858391296:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 530us (1042us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788623016.623552:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:1.0:1788623016.627081:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.627154:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858391552 00000100:00100000:2.0:1788623016.627166:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858391552 00000100:00100000:2.0:1788623016.627352:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 229 00000100:00100000:2.0:1788623016.627366:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:11599:x1875506858391552:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788623016.627464:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.627484:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 20 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.627497:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.627552:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 20 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.627568:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 20 pid: 6676 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.627584:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866763520:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623016.627685:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788623016.631667:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5810:1875506866763520:192.168.204.19@tcp:104: 00010000:00010000:1.0:1788623016.631709:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623016.633819:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623016.634619:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858391680 00000100:00100000:0.0:1788623016.634634:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858391680 00010000:00010000:0.0:1788623016.634694:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 21 pid: 6676 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.634790:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:0.0:1788623016.634811:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:2349:x1875506858391680:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623016.634847:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623016.634856:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 21 pid: 6676 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.635027:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 21 pid: 6676 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.635058:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372faa00/0xef842f43731d7617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaeb expref: 21 pid: 6676 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.635080:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:0.0:1788623016.635085:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.635097:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.635107:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.635135:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623016.635220:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:2349:x1875506858391680:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 419us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.635228:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 80 00010000:00010000:1.0:1788623016.635611:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635621:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635657:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635674:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635682:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635688:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fac00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623016.635693:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635702:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635714:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:1.0:1788623016.635717:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788623016.635720:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.635727:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fac00/0xef842f43731d765d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623016.635843:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:11599:x1875506858391552:12345-192.168.204.19@tcp:55:lhsmtool_posix.0 Request processed in 8480us (8773us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788623016.635852:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 229 00000100:00100000:2.0:1788623016.641798:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623016.642191:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858391808 00000100:00100000:3.0:1788623016.642205:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858391808 00000100:00100000:3.0:1788623016.642289:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 70 00000100:00100000:3.0:1788623016.642303:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858391808:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788623016.642368:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.642404:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.642415:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623016.642420:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788623016.642425:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.642474:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 8 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.642492:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 8 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.642509:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e36e60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866763648:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623016.642626:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08947d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788623016.646638:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623016.646723:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858391936 00000100:00100000:0.0:1788623016.646736:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858391936 00010000:00010000:0.0:1788623016.646827:0:7602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 9 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.647105:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e36e60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6656:1875506866763648:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623016.647144:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.647195:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:0.0:1788623016.647208:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+9:2348:x1875506858391936:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623016.647341:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623016.647558:0:7602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 9 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.647575:0:7602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 9 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.647603:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004255720b/0xef842f43731d7641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb07 expref: 9 pid: 6655 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.647622:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623016.647626:0:7602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788623016.647632:0:7602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.647643:0:7602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.647682:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623016.647799:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858391936:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 594us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.647816:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 81 00010000:00010000:3.0:1788623016.648718:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.648734:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.648818:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.648828:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.648837:0:6656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.648845:0:6656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623016.648851:0:6656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.649457:0:6656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.649484:0:6656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.649509:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006591db63/0xef842f43731d7664 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.649700:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858391808:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 Request processed in 7395us (7955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623016.649710:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 70 00000100:00100000:2.0:1788623016.652161:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623016.652313:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858392192 00000100:00100000:3.0:1788623016.652329:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858392192 00000100:00100000:3.0:1788623016.652559:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 230 00000100:00100000:3.0:1788623016.652571:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:11599:x1875506858392192:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788623016.652680:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.652700:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.652714:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.653194:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.653211:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.653222:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.653349:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.653367:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 20 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.653384:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e36e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866763776:192.168.204.19@tcp:104: 00000100:00100000:3.0:1788623016.653487:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08947d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788623016.658307:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.658489:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e36e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866763776:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623016.658524:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.658614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858392320 00000100:00100000:0.0:1788623016.658624:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858392320 00010000:00010000:0.0:1788623016.658672:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 21 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.658720:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:0.0:1788623016.658732:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:2348:x1875506858392320:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623016.658793:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623016.658967:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 21 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.658984:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 21 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.659014:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eaf2 expref: 21 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.659034:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:0.0:1788623016.659040:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.659051:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.659061:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.659091:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623016.659153:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:2348:x1875506858392320:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 424us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.659178:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 82 00010000:00010000:3.0:1788623016.660575:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.660591:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788623016.662828:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788623016.663109:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788623016.663194:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788623016.663577:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5811:1875506866763904:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788623016.663981:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623016.664030:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788623016.664278:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866763904 00000100:00100000:0.0:1788623016.664289:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866763904 00000100:00100000:0.0:1788623016.664349:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788623016.664359:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875506866763904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788623016.664484:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875506866763904:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.664493:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788623016.664647:0:5811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788623016.664654:0:5811:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788623016.664678:0:5811:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e39b4b800, transno 4294967321 00000100:00100000:2.0:1788623016.664700:0:5811:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff997e3a317480 x1875506866763136/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788623032 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623016.664714:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5811:1875506866763904:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788623016.666135:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788623016.666382:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5811:1875506866764032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788623016.666457:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623016.666524:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788623016.668617:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866764032 00000100:00100000:0.0:1788623016.668635:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866764032 00000100:00100000:0.0:1788623016.668707:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788623016.668719:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875506866764032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788623016.669568:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5811:x1875506866764032:12345-0@lo:1000:mdt00_002.0 Request processed in 847us (3106us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788623016.669580:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788623016.669664:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5811:1875506866764032:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788623016.673092:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.673111:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.673120:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.673127:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.673133:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.673142:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.673186:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e07097d00) 00010000:00010000:2.0:1788623016.673190:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788623016.673195:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.673202:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734200/0xef842f43731d7672 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674064:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674079:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674087:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674094:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bada00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.674097:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674105:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674121:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623016.674124:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788623016.674136:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674149:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674179:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.674253:0:5811:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.674274:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866764160:192.168.204.19@tcp:105: 00000100:00100000:2.0:1788623016.674422:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788623016.678592:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5811:1875506866764160:192.168.204.19@tcp:105: 00010000:00010000:2.0:1788623016.678644:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678658:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bada00/0xef842f43731d75b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678730:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678775:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678790:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678802:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678809:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678833:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678839:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fb400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.678844:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678853:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678875:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623016.678878:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623016.678883:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678889:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d7679 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678901:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678908:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678914:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678920:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623016.678922:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678938:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678947:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623016.678949:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788623016.678952:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.678957:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d766b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.680454:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:11599:x1875506858392192:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 27875us (28292us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788623016.680472:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 230 00000020:00080000:2.0:1788623016.680481:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788623016.680569:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.681155:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858392448 00000100:00100000:2.0:1788623016.681167:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858392448 00000100:00100000:2.0:1788623016.681250:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:2.0:1788623016.681261:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:11598:x1875506858392448:12345-192.168.204.19@tcp:49:lfs.0 00000100:00100000:2.0:1788623016.681400:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:11598:x1875506858392448:12345-192.168.204.19@tcp:49:lfs.0 Request processed in 141us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.681407:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 61 00000100:00100000:3.0:1788623016.683875:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000040:00080000:1.0:1788623016.684185:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788623016.684191:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788623016.684704:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788623016.684715:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788623016.686907:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.687475:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858392960 00000100:00100000:1.0:1788623016.687509:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858392960 00000100:00100000:1.0:1788623016.687601:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 62 00000100:00100000:1.0:1788623016.687613:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+23:11599:x1875506858392960:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788623016.688467:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858392704 00000100:00100000:0.0:1788623016.688546:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858392704 00000004:00080000:1.0:1788623016.689348:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788623016.689494:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1788623016.689587:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.689608:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.689623:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.689634:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.689637:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 231 00010000:00010000:1.0:1788623016.689646:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.689656:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623016.689656:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11598:x1875506858392704:12345-192.168.204.19@tcp:58:lfs.0 00010000:00010000:1.0:1788623016.689769:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788623016.689908:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11599:x1875506858392960:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 2295us (3011us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788623016.689920:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 62 00000040:00080000:0.0:1788623016.689921:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000020:00080000:1.0:1788623016.689927:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788623016.689980:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:11598:x1875506858392704:12345-192.168.204.19@tcp:58:lfs.0 Request processed in 330us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.689988:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 231 00010000:00010000:3.0:1788623016.694936:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623016.694956:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.694970:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dac00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623016.694976:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.694988:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.695042:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff997e11991500) 00010000:00010000:3.0:1788623016.695046:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788623016.695052:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.695059:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7680 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623016.695091:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623016.695093:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623016.695095:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623016.718447:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623016.719084:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393088 00000100:00100000:1.0:1788623016.719098:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393088 00000100:00100000:1.0:1788623016.719191:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 232 00000100:00100000:1.0:1788623016.719224:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+25:11601:x1875506858393088:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788623016.719260:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623016.719290:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7687 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb0e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.719382:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.719403:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.719417:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.719438:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.719445:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.719452:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.720575:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.720598:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.720887:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.720961:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623016.720983:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 26 pid: 5811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623016.721003:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866764288:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623016.721366:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e011caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788623016.731671:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623016.731832:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393344 00000100:00100000:3.0:1788623016.731847:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393344 00000100:00100000:0.0:1788623016.731872:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5809:1875506866764288:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788623016.731917:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623016.731942:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:3.0:1788623016.731958:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:5587:x1875506858393344:12345-192.168.204.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788623016.732271:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:5587:x1875506858393344:12345-192.168.204.19@tcp:35:ldlm_bl.0 Request processed in 315us (610us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788623016.734099:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 63 00000100:00100000:1.0:1788623016.739705:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623016.740013:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393472 00000100:00100000:2.0:1788623016.740028:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393472 00010000:00010000:2.0:1788623016.740101:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 28 pid: 5811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.740181:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:2.0:1788623016.740194:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:2348:x1875506858393472:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788623016.740218:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623016.740227:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 28 pid: 5811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.740242:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 28 pid: 5811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.740283:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08bad200/0xef842f43731d75a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eacf expref: 28 pid: 5811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.740305:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623016.740312:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.740325:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.740334:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623016.740375:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788623016.740415:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740426:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623016.740452:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:2348:x1875506858393472:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 261us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623016.740462:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 83 00000004:00200000:0.0:1788623016.740484:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788623016.740491:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623016.740517:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740547:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740559:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740567:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740575:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740582:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623016.740587:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740596:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740607:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:0.0:1788623016.740619:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623016.740624:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740631:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db400/0xef842f43731d768e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740645:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740652:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740659:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740665:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0da400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623016.740668:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740674:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740682:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff997e11991700) 00010000:00010000:0.0:1788623016.740685:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623016.740689:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740695:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da400/0xef842f43731d7695 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740736:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db000/0xef842f43731d7687 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb0e expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740819:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb0e expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623016.740827:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623016.740830:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623016.740833:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db200, rc 0) 00000100:00100000:0.0:1788623016.740875:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11601:x1875506858393088:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 21655us (22440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623016.740883:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 232 00010000:00010000:3.0:1788623016.876842:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623017.181069:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623017.181153:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623017.181195:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623017.181226:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623017.181492:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393856 00000100:00100000:2.0:1788623017.181535:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393856 00000100:00100000:2.0:1788623017.181626:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393728 00000100:00100000:2.0:1788623017.181629:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393728 00000100:00100000:2.0:1788623017.181663:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:2.0:1788623017.181675:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858393856:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623017.181802:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858393856:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 130us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623017.181810:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:2.0:1788623017.181832:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:2.0:1788623017.181839:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858393728:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623017.181865:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2350:x1875506858393728:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623017.181871:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:2.0:1788623017.181895:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393984 00000100:00100000:2.0:1788623017.181900:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393984 00000100:00100000:2.0:1788623017.181929:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 159 00000100:00100000:2.0:1788623017.181937:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2350:x1875506858393984:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623017.181972:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2350:x1875506858393984:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 37us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623017.181979:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 159 00000100:00080000:0.0:1788623017.183249:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788623017.183259:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788623017.196871:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858393600 00000100:00100000:3.0:1788623017.196894:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858393600 00000100:00100000:3.0:1788623017.196971:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 300 00000100:00100000:3.0:1788623017.196985:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858393600:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623017.197168:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858393600:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 186us (16114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623017.197177:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 300 00000001:00080000:0.0:1788623017.601544:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788623017.601570:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:1.0:1788623017.671967:0:12473:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788623017.671980:0:12473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788623017.672028:0:12473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788623017.672034:0:12473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788623017.708036:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788623017.708051:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788623017.708112:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788623017.708120:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788623017.708266:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866764416:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788623017.708379:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788623017.720631:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623017.720669:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858394112 00000100:00100000:3.0:1788623017.720678:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858394112 00000100:00100000:3.0:1788623017.720732:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 233 00000100:00100000:3.0:1788623017.720763:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:11612:x1875506858394112:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788623017.720798:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788623017.720893:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:11612:x1875506858394112:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 152us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623017.720900:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 233 00000100:00100000:1.0:1788623017.722009:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875506866764416:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788623017.726738:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623017.727099:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858394368 00000100:00100000:3.0:1788623017.727111:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858394368 00000100:00100000:3.0:1788623017.727177:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 234 00000100:00100000:3.0:1788623017.727189:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+26:11612:x1875506858394368:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788623017.727210:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623017.727233:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d76a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb15 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623017.727340:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d76aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623017.727355:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d76aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623017.727370:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d76aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623017.727382:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788623017.727528:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734800/0xef842f43731d76a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb15 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623017.727575:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d76aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb15 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623017.727585:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:3.0:1788623017.727588:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788623017.727592:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735a00, rc 0) 00000100:00100000:3.0:1788623017.727658:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:11612:x1875506858394368:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 471us (935us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788623017.727665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 234 00000100:00100000:3.0:1788623017.741088:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623017.741147:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858394496 00000100:00100000:0.0:1788623017.741158:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858394496 00000100:00100000:0.0:1788623017.741231:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:0.0:1788623017.741242:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:2350:x1875506858394496:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623017.741263:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623017.741289:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735a00/0xef842f43731d76aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb15 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623017.741325:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:0.0:1788623017.741331:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623017.741382:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:2350:x1875506858394496:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 142us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623017.741390:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:3.0:1788623017.745334:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623017.745397:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858394752 00000100:00100000:2.0:1788623017.745407:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858394752 00000100:00100000:2.0:1788623017.745467:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 235 00000100:00100000:2.0:1788623017.745478:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+27:11612:x1875506858394752:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788623017.745578:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745601:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745614:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745830:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745839:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745846:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745852:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fb400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623017.745856:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745864:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745877:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:2.0:1788623017.745880:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788623017.745885:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623017.745891:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb400/0xef842f43731d76b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623017.746050:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:11612:x1875506858394752:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 572us (723us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788623017.746063:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 235 00000040:00080000:0.0:1788623017.746226:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788623017.746231:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788623017.746711:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788623017.746719:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788623017.753622:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623017.753727:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395008 00000100:00100000:3.0:1788623017.753737:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395008 00000100:00100000:3.0:1788623017.753821:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 64 00000100:00100000:3.0:1788623017.753831:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+28:11612:x1875506858395008:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788623017.754071:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:11612:x1875506858395008:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 240us (462us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788623017.754079:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 64 00010000:00010000:2.0:1788623017.900034:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623018.028416:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788623018.030141:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e36e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866764672:0@lo:400:kworker.0 00000100:00100000:0.0:1788623018.030428:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623018.030564:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866764544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623018.030590:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623018.030764:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866764544 00000100:00100000:2.0:1788623018.030785:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866764544 00000100:00100000:2.0:1788623018.030851:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788623018.030866:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866764544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788623018.030912:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623018.030955:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866764544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623018.030962:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788623018.031724:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866764672 00000100:00100000:1.0:1788623018.031733:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866764672 00000100:00100000:1.0:1788623018.032016:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788623018.032025:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623018.032090:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866764672:12345-0@lo:400:kworker.0 Request processed in 67us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623018.032115:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788623018.032286:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e36e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866764800:0@lo:400:kworker.0 00000100:00100000:3.0:1788623018.032323:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623018.032357:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866764928:0@lo:400:kworker.0 00000100:00100000:3.0:1788623018.032364:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866764800 00000100:00100000:3.0:1788623018.032368:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866764800 00000100:00100000:2.0:1788623018.032386:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623018.032436:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866765056:0@lo:400:kworker.0 00000100:00080000:0.0:1788623018.032446:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788623018.032462:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866765184:0@lo:400:kworker.0 00000100:00100000:1.0:1788623018.032467:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623018.032499:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765056 00000100:00100000:1.0:1788623018.032513:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765056 00000100:00100000:1.0:1788623018.032558:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788623018.032566:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875506866765056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623018.032605:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875506866765056:12345-0@lo:400:kworker.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623018.032613:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788623018.032664:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866765056:0@lo:400:kworker.0 00000100:00080000:0.0:1788623018.032872:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788623018.033851:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866764928 00000100:00100000:3.0:1788623018.033862:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866764928 00000100:00100000:1.0:1788623018.033865:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788623018.033877:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866764800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623018.033912:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788623018.033936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623018.033991:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866764928:12345-0@lo:400:kworker.0 Request processed in 58us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623018.033998:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788623018.034009:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866764800:12345-0@lo:400:kworker.0 Request processed in 137us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623018.034015:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788623018.034047:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e36e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866764800:0@lo:400:kworker.0 00000100:00100000:1.0:1788623018.034052:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623018.034078:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f2cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866764928:0@lo:400:kworker.0 00000100:00100000:1.0:1788623018.034081:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e36e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866764672:0@lo:400:kworker.0 00000100:00100000:1.0:1788623018.034093:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788623018.034098:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000100:00100000:3.0:1788623018.034111:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765184 00000004:00080000:1.0:1788623018.034113:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e3a316a00, transno 4294967310 00000100:00100000:3.0:1788623018.034114:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765184 00000100:00100000:1.0:1788623018.034133:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866764544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623018.034135:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788623018.034140:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866765184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623018.034172:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866765184:12345-0@lo:400:kworker.0 Request processed in 32us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623018.034178:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788623018.034202:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e39b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866765184:0@lo:400:kworker.0 00000100:00080000:2.0:1788623018.034387:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788623018.926381:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788623019.598504:0:12524:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788623019.598518:0:12524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788623019.598567:0:12524:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788623019.598573:0:12524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788623019.790782:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623019.790825:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395264 00000100:00100000:1.0:1788623019.790843:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395264 00000100:00100000:1.0:1788623019.790930:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 236 00000100:00100000:1.0:1788623019.790945:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+29:11634:x1875506858395264:12345-192.168.204.19@tcp:101:lfs.0 00000100:00080000:3.0:1788623019.790964:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788623019.790973:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623019.791000:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d76bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb1c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623019.791111:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d76c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623019.791127:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d76c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623019.791141:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d76c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623019.791153:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788623019.791276:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d76bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb1c expref: 32 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623019.791292:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d76c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb1c expref: 31 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623019.791301:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:1.0:1788623019.791304:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788623019.791308:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da000, rc 0) 00000100:00100000:1.0:1788623019.791372:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:11634:x1875506858395264:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 432us (603us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788623019.791380:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 236 00000100:00100000:3.0:1788623019.801842:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623019.801880:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395392 00000100:00100000:3.0:1788623019.801892:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395392 00000100:00100000:3.0:1788623019.801949:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 237 00000100:00100000:3.0:1788623019.801961:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e39b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:11634:x1875506858395392:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:3.0:1788623019.802035:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802053:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802081:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802111:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802119:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802126:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802133:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623019.802138:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802147:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802159:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:3.0:1788623019.802162:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788623019.802167:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.802173:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735200/0xef842f43731d76d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623019.802251:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e39b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+31:11634:x1875506858395392:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 292us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623019.802259:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 237 00000100:00100000:1.0:1788623019.901410:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623019.902026:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395520 00000100:00100000:2.0:1788623019.902038:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395520 00000100:00100000:3.0:1788623019.902866:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 71 00000100:00100000:3.0:1788623019.902894:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2348:x1875506858395520:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:3.0:1788623019.902914:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623019.902939:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf099f3a/0xef842f43731d76db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb23 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788623019.902970:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c38a8, atime: 0x6a9c38a7, ctime: 0x6a9c38a8, blocks: 0xb 00010000:00010000:3.0:1788623019.902991:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1788623019.902995:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623019.903005:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf099f3a/0xef842f43731d76db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb23 expref: 8 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.903024:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf099f3a/0xef842f43731d76db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb23 expref: 8 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623019.903038:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735200, rc 0) 00000100:00100000:3.0:1788623019.903130:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858395520:12345-192.168.204.19@tcp:101:cat.0 Request processed in 239us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623019.903136:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 71 00000100:00080000:2.0:1788623019.903623:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788623019.909734:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623019.909932:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395648 00000100:00100000:2.0:1788623019.909943:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395648 00002000:00100000:2.0:1788623019.910000:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff997e2ecbed80 x1875506858395648/t0(0) o3->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:95/0 lens 488/0 e 0 to 0 dl 1788623030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788623019.910012:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e2ecbed80 with x1875506858395648 ext(0->4095) 00002000:00010000:2.0:1788623019.910020:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e2ecbed80 00000100:00100000:2.0:1788623019.910057:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:2.0:1788623019.910085:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858395648:12345-192.168.204.19@tcp:3:cat.0 00000100:00100000:2.0:1788623019.910340:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+8:2348:x1875506858395648:12345-192.168.204.19@tcp:3:cat.0 Request processed in 257us (621us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788623019.910348:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00002000:00100000:2.0:1788623019.910356:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff997e2ecbed80 x1875506858395648/t0(0) o3->3d43f78d-d80c-4ed1-81b4-dc22eca474fb@192.168.204.19@tcp:95/0 lens 488/4536 e 0 to 0 dl 1788623030 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788623019.910364:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff997e2ecbed80 with x1875506858395648 ext(0->4095) 00002000:00010000:2.0:1788623019.910368:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff997e2ecbed80 00010000:00010000:3.0:1788623019.948150:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788623020.844075:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788623020.844087:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788623020.844125:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788623020.844131:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788623020.975732:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623021.618285:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866765312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788623021.618417:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623021.618537:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765312 00000100:00100000:0.0:1788623021.618545:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765312 00000100:00100000:0.0:1788623021.618609:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788623021.618621:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875506866765312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788623021.618686:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623021.618737:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875506866765312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623021.618770:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788623021.618909:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788623021.618948:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866765312:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788623021.666863:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788623021.666887:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788623021.673948:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788623021.673972:0:5831:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788623021.674004:0:5831:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff997e0735a900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788623021.674009:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e10534200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff997e0735a300 00000020:00080000:2.0:1788623021.674012:0:5831:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff997e10534f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff997e070bc400 00000020:00080000:3.0:1788623021.674081:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788623021.674324:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788623021.996347:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623022.299378:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623022.299440:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623022.299484:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623022.299514:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623022.299540:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623022.299634:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396160 00000100:00100000:2.0:1788623022.299645:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396160 00000100:00100000:2.0:1788623022.299718:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396032 00000100:00100000:2.0:1788623022.299722:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396032 00000100:00100000:2.0:1788623022.299778:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:2.0:1788623022.299790:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858396160:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623022.299903:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858396160:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 116us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623022.299911:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:2.0:1788623022.299929:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 84 00000100:00100000:2.0:1788623022.299936:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858396032:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623022.299963:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858396032:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623022.299969:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 84 00000100:00100000:1.0:1788623022.300145:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395904 00000100:00100000:1.0:1788623022.300151:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395904 00000100:00100000:1.0:1788623022.300194:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396288 00000100:00100000:1.0:1788623022.300198:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396288 00000100:00100000:1.0:1788623022.300222:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 163 00000100:00100000:1.0:1788623022.300229:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2349:x1875506858395904:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623022.300272:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2349:x1875506858395904:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 43us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623022.300279:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 163 00000100:00100000:1.0:1788623022.300292:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 164 00000100:00100000:1.0:1788623022.300298:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858396288:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623022.300318:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2349:x1875506858396288:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 21us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623022.300323:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 164 00000100:00080000:0.0:1788623022.300507:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788623022.300512:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788623022.300514:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788623022.300616:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858395776 00000100:00100000:3.0:1788623022.300621:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858395776 00000100:00100000:3.0:1788623022.300657:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 302 00000100:00100000:3.0:1788623022.300663:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858395776:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623022.300702:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858395776:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 39us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623022.300710:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 302 00010000:00010000:1.0:1788623023.020449:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623023.149360:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866765440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623023.149462:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623023.149547:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765440 00000100:00100000:0.0:1788623023.149556:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765440 00000100:00100000:0.0:1788623023.151347:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788623023.151370:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866765440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788623023.151429:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623023.151507:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866765440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623023.151514:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788623023.151547:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788623023.151610:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866765440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788623023.153651:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866765568:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.153730:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623023.153800:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997d0770b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866766080:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.153833:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623023.153864:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788623023.153870:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866765696:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.153890:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623023.153923:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866765824:0@lo:400:kworker.0 00000100:00100000:1.0:1788623023.153942:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766080 00000100:00100000:2.0:1788623023.153950:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623023.153951:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766080 00000100:00100000:2.0:1788623023.153969:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788623023.153975:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3739aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866765952:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.154001:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623023.154026:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765568 00000100:00100000:2.0:1788623023.154030:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765568 00000100:00100000:2.0:1788623023.154062:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788623023.154070:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866765568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623023.154188:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765696 00000100:00100000:1.0:1788623023.154193:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765696 00000100:00100000:1.0:1788623023.154208:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765824 00000100:00100000:1.0:1788623023.154210:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765824 00000100:00100000:1.0:1788623023.154226:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788623023.154232:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866766080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623023.154282:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866766080:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623023.154298:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788623023.154317:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788623023.154325:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866765696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623023.154357:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866765696:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623023.154363:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788623023.154374:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788623023.154380:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623023.154424:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866765824:12345-0@lo:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623023.154428:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3278:x1875506866765568:12345-0@lo:400:kworker.0 Request processed in 359us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623023.154430:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788623023.154435:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788623023.154467:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866765952 00000100:00100000:2.0:1788623023.154470:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866765952 00000100:00100000:2.0:1788623023.154499:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788623023.154506:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866765952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.154539:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866765952:12345-0@lo:400:kworker.0 Request processed in 34us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623023.154546:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788623023.154587:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866765696:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.155276:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866765568:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.155296:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997d0770b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866766080:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.155340:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788623023.155346:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e3a317480, transno 4294967322 00000004:00080000:2.0:1788623023.155362:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788623023.155376:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3739aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866765952:0@lo:400:kworker.0 00000100:00100000:2.0:1788623023.155389:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866765824:0@lo:400:kworker.0 00000100:00080000:0.0:1788623023.168248:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788623023.168262:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788623024.049371:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623025.068200:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623025.111325:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623025.111458:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396416 00000100:00100000:1.0:1788623025.111469:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396416 00000100:00100000:1.0:1788623025.111541:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 238 00000100:00100000:1.0:1788623025.111553:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3739aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11278:x1875506858396416:12345-192.168.204.19@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788623025.111678:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3739aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11278:x1875506858396416:12345-192.168.204.19@tcp:60:lhsmtool_posix.0 Request processed in 128us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623025.111696:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 238 00000100:00080000:0.0:1788623025.111903:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623025.116410:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623025.116501:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396672 00000100:00100000:1.0:1788623025.116512:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396672 00000100:00100000:1.0:1788623025.116569:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 65 00000100:00100000:1.0:1788623025.116579:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:11278:x1875506858396672:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788623025.117038:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:11278:x1875506858396672:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 458us (634us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788623025.117063:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 65 00000100:00100000:3.0:1788623025.535048:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623025.535256:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396800 00000100:00100000:2.0:1788623025.535269:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396800 00000100:00100000:2.0:1788623025.535368:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 239 00000100:00100000:2.0:1788623025.535388:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:12085:x1875506858396800:12345-192.168.204.19@tcp:101:lsof.0 00010000:00010000:2.0:1788623025.535408:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623025.535497:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d76e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb2a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623025.535568:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d76e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623025.535584:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623025.535596:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623025.535635:0:6676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788623025.535639:0:6676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788623025.535658:0:6676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623025.535700:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d76e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb2a expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623025.535722:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d76e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb2a expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623025.535731:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:2.0:1788623025.535734:0:6676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788623025.535738:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fa600, rc 0) 00000100:00100000:2.0:1788623025.535859:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f2cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:12085:x1875506858396800:12345-192.168.204.19@tcp:101:lsof.0 Request processed in 474us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623025.535866:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 239 00000100:00080000:0.0:1788623025.537072:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788623026.092276:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623026.735769:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788623026.735796:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866766208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788623026.735875:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623026.735954:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766208 00000100:00100000:0.0:1788623026.735962:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766208 00000100:00100000:0.0:1788623026.736020:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788623026.736030:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866766208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788623026.736069:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623026.736118:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866766208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623026.736125:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788623026.736152:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788623026.736203:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866766208:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788623026.808591:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788623026.808615:0:5831:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788623026.808670:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788623026.808682:0:5842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788623027.115957:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623027.416895:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623027.416964:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623027.417001:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623027.417040:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623027.417073:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623027.417102:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397440 00000100:00100000:2.0:1788623027.417111:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397440 00000100:00100000:2.0:1788623027.417166:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 168 00000100:00100000:2.0:1788623027.417179:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2351:x1875506858397440:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623027.417273:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2351:x1875506858397440:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623027.417281:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 168 00000100:00100000:2.0:1788623027.417299:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397056 00000100:00100000:2.0:1788623027.417302:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397056 00000100:00100000:2.0:1788623027.417332:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 169 00000100:00100000:2.0:1788623027.417339:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2351:x1875506858397056:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623027.417369:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2351:x1875506858397056:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623027.417376:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 169 00000100:00100000:3.0:1788623027.417846:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858396928 00000100:00100000:3.0:1788623027.417852:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858396928 00000100:00100000:3.0:1788623027.417889:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 304 00000100:00100000:3.0:1788623027.417896:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2351:x1875506858396928:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623027.417925:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2351:x1875506858396928:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 31us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623027.417931:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 304 00000100:00100000:0.0:1788623027.418421:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397184 00000100:00100000:0.0:1788623027.418426:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397184 00000100:00100000:0.0:1788623027.418470:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397312 00000100:00100000:0.0:1788623027.418472:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397312 00000100:00100000:0.0:1788623027.418494:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 86 00000100:00100000:0.0:1788623027.418500:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2351:x1875506858397184:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623027.418535:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2351:x1875506858397184:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 36us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623027.418541:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 86 00000100:00100000:0.0:1788623027.418552:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:0.0:1788623027.418558:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858397312:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623027.418590:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2351:x1875506858397312:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 32us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623027.418597:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00080000:0.0:1788623027.418616:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788623027.418620:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788623027.418623:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788623028.140520:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623028.268266:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866766720:0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.268358:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623028.268431:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788623028.268587:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866766592:0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.268621:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623028.268658:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766592 00000100:00100000:2.0:1788623028.268667:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766592 00000100:00100000:2.0:1788623028.268770:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788623028.268783:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866766592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.269065:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866766592:12345-0@lo:400:kworker.0 Request processed in 284us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623028.269074:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788623028.269124:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866766592:0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269247:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866766336:0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269288:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623028.269339:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866766848:0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269363:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623028.269387:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788623028.269393:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866766464:0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269417:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623028.269434:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866766976:0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269487:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623028.269516:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766848 00000100:00100000:3.0:1788623028.269530:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766848 00000100:00100000:3.0:1788623028.269560:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766464 00000100:00100000:3.0:1788623028.269562:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766464 00000100:00100000:3.0:1788623028.269578:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788623028.269585:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866766848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269625:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866766848:12345-0@lo:400:kworker.0 Request processed in 41us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623028.269632:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788623028.269645:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788623028.269651:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269676:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866766464:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623028.269695:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788623028.269723:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866766464:0@lo:400:kworker.0 00000100:00100000:3.0:1788623028.269732:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866766848:0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.270095:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766336 00000100:00100000:2.0:1788623028.270100:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766336 00000100:00100000:2.0:1788623028.270136:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788623028.270143:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866766336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.270193:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866766336:12345-0@lo:400:kworker.0 Request processed in 51us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623028.270199:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788623028.270288:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866766336:0@lo:400:kworker.0 00000100:00100000:0.0:1788623028.270850:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766720 00000100:00100000:0.0:1788623028.270857:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766720 00000100:00100000:0.0:1788623028.270901:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866766976 00000100:00100000:0.0:1788623028.270905:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866766976 00000100:00100000:0.0:1788623028.270934:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788623028.270939:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866767104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623028.270948:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866766720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623028.270994:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623028.271016:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866766720:12345-0@lo:400:kworker.0 Request processed in 61us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623028.271026:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788623028.271045:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788623028.271052:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866766976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.271243:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866766720:0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.271280:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767104 00000100:00100000:2.0:1788623028.271284:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767104 00000100:00100000:2.0:1788623028.271321:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788623028.271328:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866767104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788623028.271360:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623028.271400:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866767104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623028.271406:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788623028.271430:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788623028.271434:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788623028.271437:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623028.271549:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866766976:12345-0@lo:400:kworker.0 Request processed in 498us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623028.271615:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866766976:0@lo:400:kworker.0 00000100:00100000:2.0:1788623028.271654:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866767104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623028.276264:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00010000:1.0:1788623029.164031:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788623029.773575:0:12729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:43:48 (1788623028) 00000040:00080000:3.0:1788623030.062786:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788623030.062796:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788623030.063284:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788623030.063291:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788623030.198722:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623031.215326:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623031.855098:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866767232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788623031.855187:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623031.855287:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767232 00000100:00100000:2.0:1788623031.855295:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767232 00000100:00100000:2.0:1788623031.855349:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788623031.855360:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866767232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788623031.855396:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623031.855440:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866767232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623031.855447:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788623031.855466:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788623031.862633:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866767232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788623032.238307:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623032.541346:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623032.541394:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623032.541427:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623032.541454:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623032.541491:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623032.541523:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397824 00000100:00100000:2.0:1788623032.541532:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397824 00000100:00100000:2.0:1788623032.541580:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397952 00000100:00100000:2.0:1788623032.541583:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397952 00000100:00100000:2.0:1788623032.541603:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 90 00000100:00100000:2.0:1788623032.541612:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858397824:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623032.541677:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2349:x1875506858397824:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 66us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623032.541683:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 90 00000100:00100000:2.0:1788623032.541712:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 91 00000100:00100000:2.0:1788623032.541719:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858397952:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623032.541779:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2349:x1875506858397952:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 61us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623032.541784:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 91 00000100:00080000:2.0:1788623032.541800:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788623032.541804:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788623032.542152:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397568 00000100:00100000:1.0:1788623032.542157:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397568 00000100:00100000:1.0:1788623032.542196:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 306 00000100:00100000:1.0:1788623032.542204:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858397568:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623032.542271:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2349:x1875506858397568:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 50us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623032.542279:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 306 00000100:00100000:1.0:1788623032.542317:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858398080 00000100:00100000:1.0:1788623032.542321:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858398080 00000100:00100000:1.0:1788623032.542357:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858397696 00000100:00100000:1.0:1788623032.542361:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858397696 00000100:00100000:1.0:1788623032.542393:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 173 00000100:00100000:1.0:1788623032.542403:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2349:x1875506858398080:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623032.542446:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2349:x1875506858398080:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 45us (1017us total) trans 0 rc 0/0 00000100:00080000:3.0:1788623032.542452:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623032.542467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 173 00000100:00100000:1.0:1788623032.542491:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 174 00000100:00100000:1.0:1788623032.542768:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2349:x1875506858397696:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623032.542813:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:2349:x1875506858397696:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 314us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623032.547531:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 174 00010000:00010000:0.0:1788623033.261296:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623033.388833:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788623033.388859:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866767360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788623033.388935:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623033.389124:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866767872:0@lo:400:kworker.0 00000100:00100000:1.0:1788623033.389153:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623033.389175:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788623033.389180:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866767488:0@lo:400:kworker.0 00000100:00100000:1.0:1788623033.389219:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623033.389243:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866768000:0@lo:400:kworker.0 00000100:00100000:1.0:1788623033.389269:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623033.389312:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767488 00000100:00100000:1.0:1788623033.389320:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767488 00000100:00100000:1.0:1788623033.389364:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788623033.389372:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623033.389417:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e07328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866767488:12345-0@lo:400:kworker.0 Request processed in 45us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623033.389654:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768000 00000100:00100000:0.0:1788623033.389659:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768000 00000100:00100000:0.0:1788623033.389714:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788623033.389722:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866768000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623033.389790:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875506866768000:12345-0@lo:400:kworker.0 Request processed in 70us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623033.389814:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1788623033.389847:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623033.389885:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866767488:0@lo:400:kworker.0 00000100:00100000:0.0:1788623033.389901:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875506866768000:0@lo:400:kworker.0 00000100:00100000:3.0:1788623033.389976:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866767616:0@lo:400:kworker.0 00000100:00100000:3.0:1788623033.390009:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623033.390031:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788623033.390038:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866767744:0@lo:400:kworker.0 00000100:00100000:0.0:1788623033.390070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767616 00000100:00100000:0.0:1788623033.390075:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767616 00000100:00100000:3.0:1788623033.390076:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623033.390106:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767744 00000100:00100000:0.0:1788623033.390110:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767744 00000100:00100000:3.0:1788623033.390114:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767360 00000100:00100000:3.0:1788623033.390128:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767360 00000100:00100000:0.0:1788623033.390139:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788623033.390150:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623033.390168:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788623033.390178:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866767360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623033.390192:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866767616:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623033.390199:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00002000:00000024:3.0:1788623033.390222:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623033.390229:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788623033.390237:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e41d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866767744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623033.390267:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866767360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623033.390277:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788623033.390278:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e41d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866767744:12345-0@lo:400:kworker.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623033.390287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788623033.390307:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788623033.390310:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623033.391408:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788623033.391624:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866767872 00000100:00100000:2.0:1788623033.391633:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866767872 00000100:00100000:2.0:1788623033.391696:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788623033.391718:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866767872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623033.391804:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866767872:12345-0@lo:400:kworker.0 Request processed in 101us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623033.391810:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788623033.391834:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788623033.398232:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866767360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788623033.398283:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866767872:0@lo:400:kworker.0 00000100:00100000:3.0:1788623033.400071:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866767744:0@lo:400:kworker.0 00000100:00100000:3.0:1788623033.400091:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866767616:0@lo:400:kworker.0 00000100:00100000:0.0:1788623033.950873:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623033.950984:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858398336 00000100:00100000:3.0:1788623033.950995:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858398336 00000100:00100000:3.0:1788623033.951070:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 66 00000100:00100000:3.0:1788623033.951080:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+18:12306:x1875506858398336:12345-192.168.204.19@tcp:35:umount.0 00000100:00100000:3.0:1788623033.951685:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:12306:x1875506858398336:12345-192.168.204.19@tcp:35:umount.0 Request processed in 604us (823us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788623033.951694:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 66 00000100:00100000:0.0:1788623033.959285:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623033.959500:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858398592 00000100:00100000:3.0:1788623033.959511:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858398592 00000100:00100000:3.0:1788623033.959575:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:3.0:1788623033.959585:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+19:12306:x1875506858398592:12345-192.168.204.19@tcp:35:umount.0 00000100:00100000:3.0:1788623033.959996:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:12306:x1875506858398592:12345-192.168.204.19@tcp:35:umount.0 Request processed in 411us (721us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788623033.960004:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 67 00000100:00100000:0.0:1788623033.964610:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623033.965132:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858398848 00000100:00100000:3.0:1788623033.965143:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858398848 00000100:00100000:3.0:1788623033.965274:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:3.0:1788623033.965285:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e182e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+20:12306:x1875506858398848:12345-192.168.204.19@tcp:35:umount.0 00000100:00100000:3.0:1788623033.966425:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e182e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:12306:x1875506858398848:12345-192.168.204.19@tcp:35:umount.0 Request processed in 1133us (1817us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788623033.966438:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 68 00000100:00100000:2.0:1788623033.974957:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623033.975975:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858399104 00000100:00100000:3.0:1788623033.976645:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858399104 00000100:00100000:3.0:1788623033.976725:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:3.0:1788623033.976736:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:12306:x1875506858399104:12345-192.168.204.19@tcp:35:umount.0 00000100:00100000:3.0:1788623033.977682:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:12306:x1875506858399104:12345-192.168.204.19@tcp:35:umount.0 Request processed in 943us (2792us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788623033.977692:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 69 00000100:00100000:0.0:1788623033.984397:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623033.984441:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623033.984469:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623033.984531:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858399232 00000100:00100000:3.0:1788623033.984542:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858399232 00000100:00100000:3.0:1788623033.984603:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858399488 00000100:00100000:3.0:1788623033.984606:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858399488 00000100:00100000:3.0:1788623033.984620:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858399360 00000100:00100000:3.0:1788623033.984623:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858399360 00000100:00100000:3.0:1788623033.984639:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788623033.984647:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+15:2350:x1875506858399232:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623033.984664:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623033.984682:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bad800/0xef842f43731d66ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6b5 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623033.984702:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623033.984798:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+14:2350:x1875506858399232:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623033.984837:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:3.0:1788623033.984857:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:3.0:1788623033.984863:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+13:2350:x1875506858399488:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623033.984871:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623033.984881:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb400/0xef842f43731d694b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e780 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623033.984891:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623033.984922:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:2350:x1875506858399488:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623033.984929:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:3.0:1788623033.984971:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:3.0:1788623033.984976:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:2350:x1875506858399360:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623033.984983:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623033.985007:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13734600/0xef842f43731d66c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e67d expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623033.985016:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623033.985398:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2350:x1875506858399360:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 350us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623033.985406:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:3.0:1788623033.986008:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623033.986270:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858399616 00000100:00100000:2.0:1788623033.986278:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858399616 00000100:00100000:2.0:1788623033.986326:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:2.0:1788623033.986345:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2347:x1875506858399616:12345-192.168.204.19@tcp:9:umount.0 00000020:00000080:2.0:1788623033.986370:0:6657:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6a39 00000100:00080000:2.0:1788623033.986381:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997e07a8d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788623033.986420:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788623033.986818:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623033.993054:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+2:2347:x1875506858399616:12345-192.168.204.19@tcp:9:umount.0 Request processed in 6698us (7035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623033.993072:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 72 00000100:00100000:2.0:1788623034.000631:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623034.001224:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858400000 00000100:00100000:3.0:1788623034.001236:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858400000 00000100:00080000:2.0:1788623034.001368:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788623034.001596:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 73 00000100:00100000:3.0:1788623034.001617:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+7:2347:x1875506858400000:12345-192.168.204.19@tcp:9:umount.0 00000020:00000080:3.0:1788623034.001648:0:8422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6ca1 00000020:00010000:3.0:1788623034.001657:0:8422:0:(genops.c:1921:obd_stale_export_put()) Put export ffff997e39c9c000: total 0 00000100:00080000:3.0:1788623034.001662:0:8422:0:(import.c:65:import_set_state_nolock()) ffff997e39c9f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788623034.001712:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788623034.002041:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+5:2347:x1875506858400000:12345-192.168.204.19@tcp:9:umount.0 Request processed in 427us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623034.002049:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 73 00000020:00010000:2.0:1788623034.002367:0:7601:0:(genops.c:1907:obd_stale_export_get()) Get export ffff997e39c9c000: total 0 00010000:00010000:2.0:1788623034.002402:0:7601:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff997e39c9c000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788623034.002464:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf099f3a/0xef842f43731d76db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb23 expref: 4 pid: 8422 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623034.002501:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0fa631/0xef842f43731d703d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e955 expref: 3 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623034.002516:0:7601:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff997e39c9c000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788623034.002529:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623034.002531:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623034.002533:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623034.023400:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623034.023579:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858401024 00000100:00100000:0.0:1788623034.023589:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858401024 00000100:00100000:0.0:1788623034.023722:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 240 00000100:00100000:0.0:1788623034.023733:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+22:2347:x1875506858401024:12345-192.168.204.19@tcp:39:umount.0 00000020:00000080:0.0:1788623034.023800:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d66d5 00000020:00010000:0.0:1788623034.023817:0:5810:0:(genops.c:1921:obd_stale_export_put()) Put export ffff997d04f0d000: total 0 00000100:00080000:0.0:1788623034.023823:0:5810:0:(import.c:65:import_set_state_nolock()) ffff997d04f0a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788623034.023846:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788623034.024515:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d43f78d-d80c-4ed1-81b4-dc22eca474fb+21:2347:x1875506858401024:12345-192.168.204.19@tcp:39:umount.0 Request processed in 781us (1189us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788623034.024525:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 240 00000020:00010000:3.0:1788623034.025796:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff997d04f0d000: total 0 00010000:00010000:3.0:1788623034.025853:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff997d04f0d000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788623034.025888:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788623034.025903:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788623034.025914:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734000/0xef842f43731d7028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e94e expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.025938:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:3.0:1788623034.025941:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788623034.025945:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db200/0xef842f43731d769c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb0e expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.025957:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:3.0:1788623034.025960:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788623034.025964:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da000/0xef842f43731d76c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb1c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.025975:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788623034.025978:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788623034.025997:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734a00/0xef842f43731d6ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e940 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026013:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff997e07097900) 00010000:00010000:3.0:1788623034.026015:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788623034.026018:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e08badc00/0xef842f43731d699f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e78e expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026047:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623034.026049:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788623034.026053:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734c00/0xef842f43731d739a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ea4a expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026066:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788623034.026069:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788623034.026072:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285600/0xef842f43731d6cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e87c expref: 14 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026084:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff997e11ed0c00) 00010000:00010000:3.0:1788623034.026086:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788623034.026089:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13735400/0xef842f43731d70bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e978 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026105:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff997e07097700) 00010000:00010000:3.0:1788623034.026107:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788623034.026110:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d6f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e908 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026123:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff997e05312f00) 00010000:00010000:3.0:1788623034.026130:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788623034.026135:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9600/0xef842f43731d6a0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e7aa expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026152:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff997e05312700) 00010000:00010000:3.0:1788623034.026155:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788623034.026158:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8a00/0xef842f43731d75bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ead6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026174:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:3.0:1788623034.026176:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788623034.026180:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0da600/0xef842f43731d709f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e971 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026202:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11991d00) 00010000:00010000:3.0:1788623034.026205:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623034.026504:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e07285e00/0xef842f43731d69bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e795 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623034.026523:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff997d04f0d000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788623034.026541:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623034.026543:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623034.026545:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788623034.026877:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788623034.285262:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623035.308954:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623036.332011:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623036.370517:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623036.370553:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623036.370595:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623036.370631:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858401152 00000100:00100000:0.0:1788623036.370641:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858401152 00000100:00100000:2.0:1788623036.370647:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858401408 00000100:00100000:2.0:1788623036.370652:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858401408 00000100:00100000:2.0:1788623036.370699:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858401280 00000100:00100000:2.0:1788623036.370702:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858401280 00000100:00100000:3.0:1788623036.370781:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:3.0:1788623036.370793:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+12:2349:x1875506858401408:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623036.370814:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623036.370901:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e07284e00/0xef842f43731d6944 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e779 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623036.370926:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623036.371033:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:2349:x1875506858401408:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 241us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623036.371041:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:0.0:1788623036.373090:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:0.0:1788623036.373111:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:797b375f-aaf7-47e6-9eba-3f58f94c80a1+11:2351:x1875506858401152:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623036.373130:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623036.373161:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fa200/0xef842f43731d67a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6ca expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623036.373182:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623036.373242:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858401152:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 140us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623036.373255:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:2.0:1788623036.373266:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+10:2351:x1875506858401280:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788623036.373276:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623036.373285:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fb200/0xef842f43731d67ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6f4 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623036.373296:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623036.373316:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:797b375f-aaf7-47e6-9eba-3f58f94c80a1+9:2351:x1875506858401280:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 54us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623036.373323:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:0.0:1788623036.375143:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:0.0:1788623036.391970:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623036.392097:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858401664 00000100:00100000:2.0:1788623036.392109:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858401664 00000100:00100000:2.0:1788623036.392199:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 241 00000100:00100000:2.0:1788623036.392211:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+6:2347:x1875506858401664:12345-192.168.204.19@tcp:39:umount.0 00000020:00000080:2.0:1788623036.392265:0:5811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d67bc 00000020:00010000:2.0:1788623036.392274:0:5811:0:(genops.c:1921:obd_stale_export_put()) Put export ffff997e0847b800: total 0 00000100:00080000:2.0:1788623036.392279:0:5811:0:(import.c:65:import_set_state_nolock()) ffff997e0847d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788623036.392313:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788623036.392549:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:586e4fc9-71b3-4f30-b3e0-c9044a9b04ab+5:2347:x1875506858401664:12345-192.168.204.19@tcp:39:umount.0 Request processed in 340us (589us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788623036.392557:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 241 00000020:00010000:1.0:1788623036.392578:0:5798:0:(genops.c:1907:obd_stale_export_get()) Get export ffff997e0847b800: total 0 00010000:00010000:1.0:1788623036.392583:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623036.392632:0:5798:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff997e0847b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788623036.392667:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991f00) 00010000:00010000:1.0:1788623036.392671:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788623036.392679:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d76e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb2a expref: 4 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623036.392703:0:5798:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff997e0847b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788623036.392711:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623036.392713:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623036.392715:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788623036.392960:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623036.422288:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623036.422468:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858401920 00000100:00100000:2.0:1788623036.422479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858401920 00000100:00100000:2.0:1788623036.422545:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 308 00000100:00100000:2.0:1788623036.422556:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+7:2347:x1875506858401920:12345-192.168.204.19@tcp:251:umount.0 00000020:00000080:2.0:1788623036.422602:0:5804:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d66b2 00000020:00010000:2.0:1788623036.422611:0:5804:0:(genops.c:1921:obd_stale_export_put()) Put export ffff997e072dc000: total 0 00000100:00080000:2.0:1788623036.422617:0:5804:0:(import.c:65:import_set_state_nolock()) ffff997e072df000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788623036.422701:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e0732b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:797b375f-aaf7-47e6-9eba-3f58f94c80a1+3:2347:x1875506858401920:12345-192.168.204.19@tcp:251:umount.0 Request processed in 146us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623036.422709:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 308 00000020:00010000:1.0:1788623036.422851:0:7601:0:(genops.c:1907:obd_stale_export_get()) Get export ffff997e072dc000: total 0 00010000:00010000:1.0:1788623036.422894:0:7601:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff997e072dc000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788623036.422929:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac600/0xef842f43731d6722 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120e6bc expref: 2 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623036.422943:0:7601:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff997e072dc000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788623036.422952:0:7601:0:(genops.c:885:class_export_put()) final put ffff997e072dc000/797b375f-aaf7-47e6-9eba-3f58f94c80a1 00010000:00010000:1.0:1788623036.422979:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623036.422981:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623036.422983:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788623036.423468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e072dc000/797b375f-aaf7-47e6-9eba-3f58f94c80a1 for MGS 00000020:00000080:2.0:1788623036.423512:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e072df000 for MGS 00000100:00100000:0.0:1788623036.974538:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788623036.974567:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866768128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788623036.974638:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623036.977183:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768128 00000100:00100000:1.0:1788623036.977198:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768128 00000100:00100000:1.0:1788623036.977270:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788623036.977417:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866768128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788623036.977456:0:6658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623036.977535:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866768128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623036.977551:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788623036.977790:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866768128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788623036.978251:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788623037.029913:0:5831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000001:00080000:2.0:1788623037.029931:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:2.0:1788623037.029941:0:5831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000001:00080000:2.0:1788623037.029946:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788623037.029963:0:5831:0:(genops.c:885:class_export_put()) final put ffff997e0847b800/586e4fc9-71b3-4f30-b3e0-c9044a9b04ab 00000020:00000080:2.0:1788623037.029987:0:5831:0:(genops.c:885:class_export_put()) final put ffff997d04f0d000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:2.0:1788623037.030000:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e0847b800/586e4fc9-71b3-4f30-b3e0-c9044a9b04ab for lustre-MDT0000 00000020:00000080:2.0:1788623037.030067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04f0d000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb for lustre-MDT0000 00000020:00000080:2.0:1788623037.030096:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e0847d800 for lustre-MDT0000 00000020:00000080:2.0:1788623037.030102:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997d04f0a800 for lustre-MDT0000 00000001:00100000:2.0:1788623037.046263:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:2.0:1788623037.046273:0:6680:0:(genops.c:885:class_export_put()) final put ffff997e39c9c000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:1.0:1788623037.046365:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e39c9c000/3d43f78d-d80c-4ed1-81b4-dc22eca474fb for lustre-OST0000 00000020:00000080:1.0:1788623037.046413:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e39c9f800 for lustre-OST0000 00010000:00010000:3.0:1788623037.357169:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788623038.057905:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:0.0:1788623038.057916:0:7614:0:(genops.c:885:class_export_put()) final put ffff997e07a8b800/3d43f78d-d80c-4ed1-81b4-dc22eca474fb 00000020:00000080:0.0:1788623038.057952:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e07a8b800/3d43f78d-d80c-4ed1-81b4-dc22eca474fb for lustre-OST0001 00000020:00000080:0.0:1788623038.058691:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e07a8d800 for lustre-OST0001 00000020:01000004:1.0:1788623038.385330:0:12931:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:3.0:1788623038.388800:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788623038.399905:0:12931:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788623038.399971:0:12931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.399988:0:12931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.399995:0:12931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.400001:0:12931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.400031:0:12931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788623038.400038:0:12931:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788623038.400063:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788623038.400068:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788623038.400075:0:12931:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788623038.400102:0:12931:0:(import.c:65:import_set_state_nolock()) ffff997e3a3e6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788623038.400241:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623038.400249:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.400256:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285200 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788623038.400260:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.400274:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623038.400281:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623038.400287:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788623038.400289:0:7601:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:3.0:1788623038.400397:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866768256:0@lo:39:umount.0 00000100:00100000:3.0:1788623038.400467:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788623038.400489:0:7601:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788623038.400518:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.400525:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788623038.400568:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866768384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788623038.400604:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788623038.400665:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623038.400670:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768384 00000100:00100000:3.0:1788623038.400679:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768384 00010000:00010000:2.0:1788623038.400687:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e07285200/0xef842f43731d6745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d674c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.400700:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623038.400701:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623038.400703:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623038.400728:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788623038.400738:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3279:x1875506866768384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623038.400768:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623038.400783:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bac800/0xef842f43731d674c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6745 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.400797:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623038.400901:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3279:1875506866768384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788623038.400921:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3279:x1875506866768384:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623038.400929:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788623038.401170:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768256 00000100:00100000:0.0:1788623038.401175:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768256 00000100:00100000:0.0:1788623038.401216:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788623038.401224:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e36e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875506866768256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788623038.401246:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d64cf 00000100:00080000:0.0:1788623038.401254:0:5810:0:(import.c:65:import_set_state_nolock()) ffff997e3a318000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788623038.401362:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e36e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3277:x1875506866768256:12345-0@lo:39:umount.0 Request processed in 139us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623038.401369:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788623038.401377:0:5810:0:(genops.c:885:class_export_put()) final put ffff997e3a31d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788623038.401439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a31d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788623038.401498:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e3a318000 for lustre-MDT0000 00010000:00010000:3.0:1788623038.401546:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788623038.401558:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e3a3e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788623038.401573:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866768256:0@lo:39:umount.0 00000100:00080000:1.0:1788623038.401625:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788623038.401628:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788623038.401633:0:12931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788623038.403212:0:12931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403229:0:12931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403237:0:12931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403244:0:12931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403292:0:12931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623038.403295:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623038.403302:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403302:0:12931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403310:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07285c00 already unused, calling callback (ffffffffc1bcdc20) 00010000:00010000:1.0:1788623038.403310:0:12931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403316:0:12931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.403322:0:12931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788623038.403324:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403333:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788623038.403340:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788623038.403346:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788623038.403349:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788623038.403380:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403387:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788623038.403422:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403430:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e07285c00/0xef842f43731d6753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d675a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403443:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788623038.403444:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866768512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623038.403447:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403452:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788623038.403455:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403461:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788623038.403475:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788623038.403480:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788623038.403481:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788623038.403494:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.403499:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788623038.403505:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623038.403508:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788623038.403513:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623038.403515:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623038.403558:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788623038.403564:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ee9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866768640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623038.403588:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623038.403629:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768512 00000100:00100000:0.0:1788623038.403635:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768512 00000100:00100000:0.0:1788623038.403680:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768640 00000100:00100000:0.0:1788623038.403683:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768640 00000100:00100000:0.0:1788623038.403706:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788623038.403714:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+19:3280:x1875506866768512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788623038.403728:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623038.403765:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e4100e000/0xef842f43731d675a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6753 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.403782:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623038.403822:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+18:3280:x1875506866768512:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623038.403829:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788623038.403844:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788623038.403849:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e104f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3280:x1875506866768640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788623038.403856:0:7602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623038.403862:0:7602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735c00/0xef842f43731d6673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d666c expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.403872:0:7602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623038.403888:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e104f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3280:x1875506866768640:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623038.403893:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788623038.403941:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866768640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623038.403948:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ee9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866768512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623038.404157:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623038.404158:0:12931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788623038.404164:0:12931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734400/0xef842f43731d666c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6673 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623038.404178:0:12931:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788623038.404185:0:12931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404192:0:12931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404200:0:12931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404206:0:12931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404228:0:12931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623038.404233:0:12931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404240:0:12931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404246:0:12931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404251:0:12931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623038.404281:0:12931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788623038.404285:0:12931:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788623038.404288:0:12931:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788623038.404319:0:12931:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788623038.404323:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788623038.404327:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788623038.404332:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788623038.404337:0:12931:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff997e37391800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788623038.404348:0:12931:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff997e39a1c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788623038.404353:0:12931:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff997e06133380) has exports, disconnecting them 00000020:00080000:1.0:1788623038.404357:0:12931:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff997e37391800), last request at 1788623033 00000020:00000080:1.0:1788623038.404363:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6634 00000100:00080000:1.0:1788623038.404378:0:12931:0:(import.c:65:import_set_state_nolock()) ffff997e37397800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788623038.404416:0:12931:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff997e37391800): rc 0 00000020:00000080:1.0:1788623038.404418:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e37391800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788623038.404425:0:12931:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff997e39a1c000), last request at 1788623033 00000020:00000080:1.0:1788623038.404428:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6569 00000100:00080000:1.0:1788623038.404432:0:12931:0:(import.c:65:import_set_state_nolock()) ffff997e39a1a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788623038.404437:0:12931:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff997e39a1c000): rc 0 00000020:00000080:1.0:1788623038.404439:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e39a1c000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788623038.404444:0:12931:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa59d41df7ae0 00000100:00080000:1.0:1788623038.404462:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788623038.404464:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788623038.404476:0:12931:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788623038.404547:0:12931:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788623038.404561:0:12931:0:(import.c:65:import_set_state_nolock()) ffff997d04ee8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788623038.404575:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788623038.404582:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788623038.404592:0:12931:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788623038.404684:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788623038.404698:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1875506866768896:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788623038.404712:0:12931:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788623038.404720:0:12931:0:(import.c:65:import_set_state_nolock()) ffff997e3a31a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788623038.404781:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff997e06133380) has no exports 00010000:00010000:2.0:1788623038.404922:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788623038.404929:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.404937:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e07284000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788623038.404940:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.404947:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623038.404954:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623038.404960:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788623038.404962:0:7601:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788623038.404964:0:7601:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788623038.404985:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.404991:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788623038.405010:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.405016:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e07284000/0xef842f43731d696e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6975 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.405026:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623038.405030:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.405035:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735800 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788623038.405050:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.405058:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623038.405064:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623038.405068:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788623038.405071:0:7601:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788623038.405073:0:7601:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788623038.405087:0:7601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.405092:0:7601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788623038.405105:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623038.405423:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623038.405453:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788623038.405467:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866769152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788623038.405520:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623038.405567:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866768768:0@lo:9:umount.0 00000100:00100000:3.0:1788623038.405596:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623038.405616:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866769024:0@lo:9:umount.0 00000100:00100000:3.0:1788623038.405635:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788623038.405662:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13735800/0xef842f43731d6420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6427 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623038.405666:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866768768 00000100:00100000:3.0:1788623038.405672:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866768768 00010000:00010000:2.0:1788623038.405686:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623038.405687:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623038.405689:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623038.405701:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769024 00000100:00100000:2.0:1788623038.405704:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769024 00000100:00100000:3.0:1788623038.405720:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788623038.405756:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788623038.405766:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875506866769024:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788623038.405779:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e37391800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788623038.405788:0:6657:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d669d 00000100:00080000:2.0:1788623038.405795:0:6657:0:(import.c:65:import_set_state_nolock()) ffff997e07345800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788623038.405824:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000020:00000080:0.0:1788623038.405904:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e39a1c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788623038.405935:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e37397800 for lustre-MDT0000 00000020:00000080:0.0:1788623038.405940:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e39a1a000 for lustre-MDT0000 00010000:00010000:0.0:1788623038.405949:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623038.406191:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3277:x1875506866769024:12345-0@lo:9:umount.0 Request processed in 427us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623038.406199:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788623038.406222:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788623038.406231:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866769280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788623038.406256:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623038.406283:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769152 00000100:00100000:2.0:1788623038.406287:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769152 00000100:00100000:2.0:1788623038.406315:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769280 00000100:00100000:2.0:1788623038.406318:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769280 00000100:00100000:2.0:1788623038.406338:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788623038.406344:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+17:3278:x1875506866769152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788623038.406353:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623038.406367:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e08bacc00/0xef842f43731d6975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d696e expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.406379:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623038.406414:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+16:3278:x1875506866769152:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623038.406421:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788623038.406432:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788623038.406438:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+15:3281:x1875506866769280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788623038.406453:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623038.406461:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735000/0xef842f43731d6427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6420 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623038.406472:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623038.406496:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1f47098-4bf9-4547-81bd-f9d9ba5d3857+14:3281:x1875506866769280:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623038.406502:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788623038.406518:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623038.406541:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3281:1875506866769280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788623038.406566:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866769152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788623038.406613:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875506866768768:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788623038.406630:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d65b6 00000100:00080000:3.0:1788623038.406642:0:6656:0:(import.c:65:import_set_state_nolock()) ffff997e3ccb9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788623038.406670:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1788623038.406739:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623038.406904:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ee9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3277:x1875506866768768:12345-0@lo:9:umount.0 Request processed in 1177us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623038.406910:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788623038.406926:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788623038.406930:0:5805:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788623038.407031:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d04ee8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788623038.407051:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788623038.407053:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788623038.407056:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866768768:0@lo:9:umount.0 00000100:00080000:0.0:1788623038.407067:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e3a31a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788623038.407078:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788623038.407079:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788623038.407082:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866769024:0@lo:9:umount.0 00000020:00080000:2.0:1788623038.414658:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff997e06133380) has no exports 00000020:00000080:2.0:1788623038.455471:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d647b 00000020:00000080:2.0:1788623038.455490:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e3a2e7800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788623038.455636:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788623038.455782:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788623038.455793:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788623038.455797:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff997e065519c0) has no exports 00000020:00000080:3.0:1788623038.456363:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6474 00000020:00000080:3.0:1788623038.456372:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e06174000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788623038.456660:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a2e7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788623038.457136:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e06174000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788623038.457212:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788623038.457458:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788623038.457465:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e397c2800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788623038.457468:0:12931:0:(genops.c:844:class_export_destroy()) destroying export ffff997e397c2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788623038.457478:0:12931:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788623038.457710:0:12931:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e370f8e40 - data ffff997e41e29360/ffff997e37364400 00000020:01000000:3.0:1788623038.458102:0:12931:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e04c5e5a0 - data ffff997e201d10d8/ffff997e08537c00 00000001:00000004:3.0:1788623038.474272:0:12931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788623038.508424:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788623038.508457:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866769408:0@lo:400:kworker.0 00000100:00100000:2.0:1788623038.508525:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623038.508604:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866769536:0@lo:400:kworker.0 00000100:00100000:2.0:1788623038.508629:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623038.508712:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769408 00000100:00100000:0.0:1788623038.508720:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769408 00000100:00100000:0.0:1788623038.508783:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769536 00000100:00100000:0.0:1788623038.508786:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769536 00000100:00100000:0.0:1788623038.508807:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788623038.508814:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1875506866769408:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788623038.508822:0:5811:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788623038.508864:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1875506866769408:12345-0@lo:400:kworker.0 Request processed in 48us (338us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788623038.508870:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788623038.508887:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788623038.508891:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1875506866769536:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788623038.508895:0:5811:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788623038.508919:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1875506866769536:12345-0@lo:400:kworker.0 Request processed in 27us (289us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788623038.508946:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788623038.509337:0:3278:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788623038.509350:0:3278:0:(import.c:65:import_set_state_nolock()) ffff997e10367800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788623038.509354:0:3278:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788623038.516993:0:3280:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788623038.517002:0:3280:0:(import.c:65:import_set_state_nolock()) ffff997d04f0b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788623038.517007:0:3280:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788623038.517014:0:3280:0:(import.c:65:import_set_state_nolock()) ffff997d04f0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788623038.517017:0:3280:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 145 00000100:00080000:0.0:1788623038.517027:0:3280:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff997d04f0b000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:0.0:1788623038.517058:0:3280:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2ecbce00 x1875506866769664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788623038.517082:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866769408:0@lo:400:kworker.0 00000100:00100000:0.0:1788623038.517131:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875506866769664:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788623038.517195:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623038.517253:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769664 00000100:00100000:0.0:1788623038.517259:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769664 00000100:00100000:0.0:1788623038.517306:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788623038.517314:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875506866769664:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788623038.517412:0:5811:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788623038.526583:0:3278:0:(import.c:65:import_set_state_nolock()) ffff997e10367800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788623038.526596:0:3278:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 165 00000100:00080000:2.0:1788623038.526607:0:3278:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff997e10367800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623038.526810:0:3278:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd02680 x1875506866769792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788623038.526849:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866769536:0@lo:400:kworker.0 00000100:00100000:2.0:1788623038.526999:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866769792:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788623038.527074:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623038.527146:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769792 00000100:00100000:2.0:1788623038.527154:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769792 00000100:00100000:2.0:1788623038.527193:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788623038.527201:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3277:x1875506866769792:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788623038.527220:0:6676:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788623038.527267:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3277:x1875506866769792:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (189us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788623038.527275:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788623038.527314:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e10367800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788623038.527319:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788623038.527322:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866769792:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788623038.545214:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875506866769664:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 27889us (28009us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788623038.545231:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788623038.545349:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d04f0b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788623038.545355:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788623038.545359:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875506866769664:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788623038.547631:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788623038.547640:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788623038.547831:0:12931:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788623038.547834:0:12931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788623038.548909:0:6688:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788623038.548915:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788623038.548925:0:6688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788623038.549846:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788623038.549861:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788623038.549877:0:12931:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788623038.549880:0:12931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788623038.550303:0:7938:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788623038.550314:0:7938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788623038.550323:0:7938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788623038.588667:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6443 00000020:00000080:0.0:1788623038.588681:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e3a3e0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788623038.589376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a3e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788623038.591032:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6458 00000020:00000080:0.0:1788623038.591046:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e3a31f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788623038.591119:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788623038.591129:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623038.591137:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788623038.591141:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff997e06124d40) has no exports 00000004:01000000:0.0:1788623038.591354:0:12931:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788623038.591363:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6696 00000020:00000080:0.0:1788623038.591369:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e072de800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788623038.591406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a31f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788623038.591474:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788623038.591479:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623038.591486:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788623038.591489:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff997d04c4b380) has no exports 00000020:00000080:0.0:1788623038.591495:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d668f 00000020:00000080:0.0:1788623038.591500:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e39c9c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788623038.591523:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e072de800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788623038.592070:0:12931:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788623038.592076:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788623038.592080:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788623038.592086:0:12931:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788623038.592089:0:12931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788623038.592154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e39c9c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788623038.592191:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623038.592199:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788623038.592203:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d65af 00000020:00000080:0.0:1788623038.592209:0:12931:0:(genops.c:885:class_export_put()) final put ffff997d04f09800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788623038.592268:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e3a31a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788623038.592274:0:8:0:(genops.c:885:class_export_put()) final put ffff997e24f09000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788623038.592276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e24f09000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788623038.592280:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788623038.592457:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788623038.592462:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623038.592467:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788623038.592470:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff997e0785b380) has no exports 00000020:00000080:0.0:1788623038.592488:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d65a8 00000020:00000080:0.0:1788623038.592491:0:12931:0:(genops.c:885:class_export_put()) final put ffff997d04ee8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788623038.592515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04f09800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788623038.593016:0:12931:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788623038.593019:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788623038.593022:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788623038.593026:0:12931:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788623038.593028:0:12931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788623038.593076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04ee8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788623038.593261:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623038.593268:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788623038.593308:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623038.593312:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788623038.593316:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e083d7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788623038.593319:0:12931:0:(genops.c:844:class_export_destroy()) destroying export ffff997e083d7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788623038.593323:0:12931:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788623038.593464:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d645f 00000020:00000080:0.0:1788623038.593470:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e3a319800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788623038.593529:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997d04ee8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788623038.593535:0:8:0:(genops.c:885:class_export_put()) final put ffff997d04eec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788623038.593537:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04eec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788623038.593541:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788623038.593664:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788623038.593669:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623038.593674:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788623038.593678:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff997e061319c0) has no exports 00000020:00000080:0.0:1788623038.593703:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623038.593706:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788623038.593710:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6466 00000020:00000080:0.0:1788623038.593715:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e3a318800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788623038.593735:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a319800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788623038.593738:0:8:0:(genops.c:885:class_export_put()) final put ffff997e3a31d800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788623038.595900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a31d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788623038.595908:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788623038.596023:0:12931:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e0835b000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788623038.596028:0:12931:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e0835b000 3 00000020:01000004:0.0:1788623038.596031:0:12931:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff997e0835b000 from lustre-MDT0000 00000020:00000080:0.0:1788623038.596064:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623038.596073:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788623038.596077:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e24f79800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788623038.596079:0:12931:0:(genops.c:844:class_export_destroy()) destroying export ffff997e24f79800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788623038.596086:0:12931:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788623038.596168:0:12931:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788623038.596172:0:12931:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788623038.596176:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788623038.596180:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623038.596183:0:12931:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788623038.596190:0:12931:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff997e078f4000 b1f47098-4bf9-4547-81bd-f9d9ba5d3857 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788623038.596197:0:12931:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff997e06553380) has exports, disconnecting them 00000020:00080000:0.0:1788623038.596201:0:12931:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff997e078f4000), last request at 1788622799 00000020:00000080:0.0:1788623038.596215:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6404 00000020:00010000:0.0:1788623038.596220:0:12931:0:(genops.c:1921:obd_stale_export_put()) Put export ffff997e078f4000: total 2 00000100:00080000:0.0:1788623038.596225:0:12931:0:(import.c:65:import_set_state_nolock()) ffff997e06176800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788623038.596239:0:12931:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff997e078f4000): rc 0 00000020:00080000:0.0:1788623038.596243:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff997e06553380) has no exports 00000020:00000080:3.0:1788623038.596554:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a318800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788623038.596628:0:5804:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff997e082ea000:5804] 2 exiting: rc = 0 00000100:00100000:1.0:1788623038.596640:0:5801:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff997e082ea400:5801] 0 exiting: rc = 1 00000020:00010000:0.0:1788623038.596769:0:5798:0:(genops.c:1907:obd_stale_export_get()) Get export ffff997e078f4000: total 0 00010000:00010000:0.0:1788623038.596793:0:5798:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff997e078f4000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788623038.596830:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e4100fe00/0xef842f43731d6768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6761 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596847:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e07284a00/0xef842f43731d6967 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6960 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596859:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e013fa000/0xef842f43731d651c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6515 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596874:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e07285000/0xef842f43731d671b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6714 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596883:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b9400/0xef842f43731d6959 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6952 expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596894:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e4100f600/0xef842f43731d6730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6729 expref: 4 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596915:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e07284400/0xef842f43731d670d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6706 expref: 3 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596924:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e07284600/0xef842f43731d673e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xef842f43731d6737 expref: 2 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623038.596935:0:5798:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff997e078f4000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788623038.596947:0:5798:0:(genops.c:885:class_export_put()) final put ffff997e078f4000/b1f47098-4bf9-4547-81bd-f9d9ba5d3857 00010000:00010000:0.0:1788623038.596961:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623038.596964:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623038.596965:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623038.596991:0:5803:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff997e0606a200:5803] 1 exiting: rc = 0 00000020:00000080:3.0:1788623038.597057:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e078f4000/b1f47098-4bf9-4547-81bd-f9d9ba5d3857 for MGS 00000020:00000080:3.0:1788623038.597079:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e06176800 for MGS 00000100:00100000:2.0:1788623038.599544:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599554:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599560:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599565:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599865:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599877:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599884:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599893:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599915:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599923:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599929:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599934:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599940:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599946:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599951:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599957:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599962:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599968:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599972:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599978:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599984:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599988:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.599993:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600000:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600005:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600011:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600018:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600023:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600029:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600034:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600040:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600045:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600052:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600058:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600063:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600069:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600075:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600080:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600086:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600091:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600098:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600113:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600119:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600131:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600137:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600143:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600149:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600154:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600160:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600166:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600171:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600175:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600180:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600186:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600190:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600195:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600201:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600206:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600211:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600217:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600222:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600227:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600233:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.600239:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788623038.601004:0:12931:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788623038.601009:0:12931:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788623038.601733:0:12931:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e103d0f60 - data ffff997d04adcca8/ffff997d045dd400 00000020:01000000:3.0:1788623038.601983:0:12931:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e082cdd20 - data ffff997e02187870/ffff997e082f8800 00000020:00000080:3.0:1788623038.602486:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d63e8 00000020:00000080:3.0:1788623038.602494:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e08365800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788623038.602558:0:12931:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e0835b000 from MGS, refs=2 00000020:01000004:3.0:1788623038.602563:0:12931:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e0835b000 2 00000020:01000004:3.0:1788623038.602566:0:12931:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff997e0835b000 from MGS 00000020:00000080:3.0:1788623038.602594:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788623038.602601:0:12931:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788623038.602604:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e08367000/MGS 00000020:00000080:3.0:1788623038.602607:0:12931:0:(genops.c:844:class_export_destroy()) destroying export ffff997e08367000/MGS for MGS 00000020:01000000:3.0:1788623038.602613:0:12931:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788623038.602667:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788623038.602671:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788623038.602677:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788623038.602683:0:12931:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff997e3a3e5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788623038.602689:0:12931:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff997e06123380) has exports, disconnecting them 00000020:00080000:3.0:1788623038.602693:0:12931:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff997e3a3e5800), last request at 1788622801 00000020:00000080:3.0:1788623038.602697:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d64b3 00000020:00080000:3.0:1788623038.602703:0:12931:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff997e3a3e5800): rc 0 00000020:00000080:3.0:1788623038.602707:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e3a3e5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788623038.602728:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e08365800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788623038.603828:0:12931:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788623038.603835:0:12931:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788623038.603840:0:12931:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788623038.603847:0:12931:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788623038.603900:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a3e5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788623038.604174:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788623038.604181:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788623038.604187:0:12931:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e0835b000 1 00000020:00000080:3.0:1788623038.604192:0:12931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d63da 00000020:00000080:3.0:1788623038.604199:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e08364000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788623038.604229:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e3a3e6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788623038.604237:0:12328:0:(genops.c:885:class_export_put()) final put ffff997e3a3e1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788623038.604240:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3a3e1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788623038.604247:0:12328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788623038.604454:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788623038.604459:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788623038.604472:0:12931:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788623038.604476:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff997e06554d40) has no exports 00000020:00000080:2.0:1788623038.607581:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e08364000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788623038.674247:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788623038.674823:0:12931:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788623038.674831:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e08367800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788623038.674841:0:12931:0:(genops.c:844:class_export_destroy()) destroying export ffff997e08367800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788623038.674861:0:12931:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788623038.675274:0:12931:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff997e08361800 00000020:01000000:2.0:1788623038.675583:0:12931:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788623038.675589:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788623038.675595:0:12931:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788623038.675604:0:12931:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff997e06134d40) has no exports 00000100:00100000:2.0:1788623038.675713:0:6676:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff997d04f03000:6676] 3 exiting: rc = 0 00000100:00100000:2.0:1788623038.676188:0:5809:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff997e079a0e00:5809] 0 exiting: rc = 1 00000100:00100000:2.0:1788623038.676469:0:5810:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff997e11687000:5810] 1 exiting: rc = 0 00000100:00100000:0.0:1788623038.678254:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff997e10378600:5811] 2 exiting: rc = 0 00000100:00100000:2.0:1788623038.678372:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678380:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678386:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678390:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678395:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678400:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678405:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678410:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678415:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678420:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678425:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678438:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678447:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678453:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678458:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678463:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678469:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678474:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678480:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678485:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678491:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678501:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678507:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678513:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678519:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678539:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678545:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678560:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678566:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678575:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678581:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678590:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678596:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678601:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678607:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678613:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678618:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678623:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678629:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678634:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678638:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678649:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678654:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678659:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678665:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678670:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678675:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678680:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678685:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678690:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678696:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678701:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678707:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678712:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678716:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678722:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678727:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678732:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678737:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678761:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678776:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678782:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678795:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.678802:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.685589:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff997e0795c600:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1788623038.685849:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff997e0603f800:5813] 1 exiting: rc = 0 00000100:00100000:0.0:1788623038.686013:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686022:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686030:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686036:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686042:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686046:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686053:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686060:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686067:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686073:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686079:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686085:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686092:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686097:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686115:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686121:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686126:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686147:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686152:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686157:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686162:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686168:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686173:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686179:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686184:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686189:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686194:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686198:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686203:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686207:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686212:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686217:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686223:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686227:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686232:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686237:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686242:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686247:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686252:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686257:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686262:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686266:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686271:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686276:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686280:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686285:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686289:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686547:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686554:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686559:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686565:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686571:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686585:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686590:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686595:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686602:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686607:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686612:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686618:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686623:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686627:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686632:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686637:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.686642:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.687308:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff997e0795de00:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1788623038.687396:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff997e03e66600:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1788623038.687519:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687527:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687532:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687539:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687545:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687550:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687555:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687561:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687566:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687572:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687578:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687584:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687605:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687613:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687620:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687627:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687635:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687645:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687652:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687659:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687665:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687673:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687680:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687696:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687717:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687724:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687730:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687736:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687772:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687779:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687785:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687791:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687797:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687870:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687878:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687885:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687905:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687915:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687921:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687927:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687937:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687943:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687949:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687955:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687961:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687967:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687972:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.687982:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688002:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688009:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688015:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688023:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688029:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688034:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688040:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688045:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688051:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688056:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688069:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688074:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688095:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688112:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688119:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.688130:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.711435:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff997e065ae600:5817] 1 exiting: rc = 0 00000100:00100000:0.0:1788623038.711586:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff997e03e66e00:5816] 0 exiting: rc = 1 00000100:00100000:2.0:1788623038.711995:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712002:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712009:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712014:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712020:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712026:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712032:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712037:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712044:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712050:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712056:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712062:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712067:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712073:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712078:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712084:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712089:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712095:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712100:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712118:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712124:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712129:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712135:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712141:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712146:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712151:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712176:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712182:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712187:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712192:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712198:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712202:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712207:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712212:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712217:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712221:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712226:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712232:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712236:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712242:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712480:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712487:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712492:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712497:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712501:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712505:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712510:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712515:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712521:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712526:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712531:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712536:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712541:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712547:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712552:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712557:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712563:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712567:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712572:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712576:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712580:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712594:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712599:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.712604:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.713651:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff997e064cb200:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1788623038.714757:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff997e064ca800:5819] 1 exiting: rc = 0 00000100:00100000:3.0:1788623038.714880:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714888:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714894:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714899:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714907:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714912:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714918:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714924:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714929:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714934:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714939:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714945:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714950:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714956:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714961:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714966:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714972:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714978:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714983:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714989:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714994:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.714999:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715004:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715009:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715014:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715019:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715024:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715029:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715033:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715038:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715043:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715049:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715071:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715076:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715083:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715088:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715094:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715100:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715118:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715124:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715130:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715135:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715142:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715147:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715153:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715168:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715174:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715180:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715185:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715190:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715195:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715201:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715206:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715210:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715215:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715220:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715225:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715230:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715235:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715241:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715246:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715433:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715438:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715444:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623038.715822:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff997e064ca000:5820] 0 exiting: rc = 1 00000100:00100000:2.0:1788623038.715858:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff997e064cba00:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1788623038.715946:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715953:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715958:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715971:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715976:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715981:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715986:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715991:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.715997:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716002:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716006:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716011:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716016:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716021:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716026:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716031:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716036:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716041:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716046:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716050:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716055:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716059:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716064:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716068:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716073:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716078:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716082:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716087:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716091:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716096:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716100:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716115:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716120:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716124:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716128:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716133:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716137:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716142:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716152:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716219:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716227:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716232:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716237:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716242:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716599:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716610:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716615:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716621:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716625:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716630:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716635:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716639:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716644:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716648:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716653:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716658:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716663:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716668:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716672:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716678:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716683:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716688:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716693:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.716698:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623038.717682:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff997e0720f200:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1788623038.717952:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff997e03e61200:5824] 2 exiting: rc = 0 00000100:00100000:2.0:1788623038.723418:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff997e0720e800:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788623038.723708:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723718:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723724:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723730:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723736:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723771:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723779:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723786:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723805:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723811:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723817:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723822:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723828:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723833:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723840:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723846:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723852:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723857:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723863:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723868:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723874:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723881:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723889:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723909:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723919:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723926:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723932:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723937:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723942:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723948:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723953:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723958:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723963:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723968:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723974:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723979:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723984:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723989:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.723995:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724001:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724007:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724012:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724017:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724029:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724035:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724039:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724045:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724062:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724069:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724074:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724079:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724085:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724091:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724096:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724115:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724122:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724127:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724132:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724138:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724145:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724150:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724154:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724332:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788623038.724338:0:12931:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788623038.729570:0:12931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788623038.729584:0:12931:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788623038.729590:0:12931:0:(genops.c:885:class_export_put()) final put ffff997e0996a000/MDS_uuid 00000020:00000080:3.0:1788623038.729595:0:12931:0:(genops.c:844:class_export_destroy()) destroying export ffff997e0996a000/MDS_uuid for MDS 00000020:01000000:3.0:1788623038.729601:0:12931:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788623038.729972:0:12931:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788623039.413249:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623040.428502:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623041.451936:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788623041.894057:0:13081:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788623041.911857:0:13081:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788623041.911911:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.912065:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.912152:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.912160:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.912217:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788623041.912223:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788623041.912246:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788623041.912251:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788623041.912258:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788623041.912264:0:13081:0:(import.c:65:import_set_state_nolock()) ffff997d04f0b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788623041.912270:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788623041.912272:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788623041.912275:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788623041.912607:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623041.912615:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623041.912622:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fbc00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788623041.912626:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623041.912636:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623041.912643:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623041.912649:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788623041.912652:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788623041.912654:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788623041.912706:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623041.912712:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788623041.912962:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788623041.913104:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623041.913113:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e013fbc00/0xef842f43731d6729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6730 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623041.913138:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623041.913140:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623041.913142:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623041.913381:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866769920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788623041.913453:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623041.913573:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866769920 00000100:00100000:2.0:1788623041.913580:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866769920 00000100:00100000:2.0:1788623041.913667:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788623041.913674:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3278:x1875506866769920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788623041.913680:0:5796:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788623041 with bad export cookie 17258971638731203588 00010000:00010000:3.0:1788623041.917762:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917783:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917792:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917799:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917818:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623041.917839:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917846:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917852:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917858:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623041.917869:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788623041.917873:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788623041.917893:0:13081:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788623041.917898:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788623041.917902:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788623041.917906:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788623041.917914:0:13081:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff997e3ccb8800 lustre-MDT0000-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967324 stale:0 00000020:00080000:3.0:1788623041.917920:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff997d04c4cd40) has no exports 00000020:00080000:3.0:1788623041.917946:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff997d04c4cd40) has no exports 00010000:00010000:0.0:1788623041.920156:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788623041.920176:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920189:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e4100e800 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788623041.920194:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920204:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788623041.920212:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623041.920218:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788623041.920221:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788623041.920224:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788623041.920272:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920281:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788623041.920313:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920337:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e4100e800/0xef842f43731d6737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d673e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920356:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623041.920360:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920365:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788623041.920368:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920374:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788623041.920380:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623041.920385:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788623041.920388:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788623041.920389:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788623041.920405:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920411:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788623041.920416:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920423:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e013fb000/0xef842f43731d6960 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xef842f43731d6967 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623041.920442:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623041.920444:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623041.920446:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623041.920475:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866770048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623041.921069:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623041.921179:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788623041.921187:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866770176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623041.921213:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623041.926343:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3278:x1875506866769920:12345-0@lo:103:ldlm_bl.0 Request processed in 12657us (12879us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788623041.926357:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788623041.926519:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866770048 00000100:00100000:1.0:1788623041.926527:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866770048 00000100:00100000:1.0:1788623041.926572:0:7602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866770176 00000100:00100000:1.0:1788623041.926575:0:7602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866770176 00000100:00100000:1.0:1788623041.926588:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788623041.926595:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3280:x1875506866770048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788623041.926602:0:7602:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788623041 with bad export cookie 17258971638731203588 00000100:00100000:1.0:1788623041.926642:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3280:x1875506866770048:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (5574us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788623041.926648:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788623041.926662:0:7602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788623041.926666:0:7602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3280:x1875506866770176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788623041.926670:0:7602:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788623041 with bad export cookie 17258971638731203588 00000100:00100000:1.0:1788623041.926694:0:7602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3280:x1875506866770176:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (5480us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788623041.926718:0:7602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788623041.926909:0:3278:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788623041.926914:0:3278:0:(import.c:65:import_set_state_nolock()) ffff997e07f2e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788623041.926918:0:3278:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788623041.927889:0:3280:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1788623041.932538:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788623041.940104:0:3278:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.119@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788623041.940111:0:3278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788623041.940123:0:3278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff997e2eec9f80 x1875506866769920/t0(0) o103->MGC192.168.204.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788623057 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788623041.940141:0:3278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff997e2ecbc000 x1875506866770048/t0(0) o103->MGC192.168.204.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788623057 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788623041.940150:0:3278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff997e2ecbc700 x1875506866770176/t0(0) o103->MGC192.168.204.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788623057 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788623041.941295:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788623041.941302:0:3278:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788623041.941304:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788623041.944609:0:3280:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff997e07f2e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788623041.944734:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866770048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788623041.944977:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3280:1875506866770176:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788623041.945027:0:3278:0:(import.c:65:import_set_state_nolock()) ffff997e07f2e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788623041.945034:0:3278:0:(import.c:545:import_select_connection()) MGC192.168.204.119@tcp: connect to NID 0@lo last attempt 123 00000100:00080000:1.0:1788623041.945053:0:3278:0:(import.c:665:import_select_connection()) MGC192.168.204.119@tcp: import ffff997e07f2e800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:1.0:1788623041.945219:0:3278:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a315c00 x1875506866770304/t0(0) o250->MGC192.168.204.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623041.945284:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3277:1875506866770304:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788623041.945337:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875506866770304 offset 0 length 520: 4 00000100:00100000:1.0:1788623041.945402:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3278:1875506866769920:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1788623042.166434:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788623042.166444:0:6680:0:(genops.c:885:class_export_put()) final put ffff997e3ccb8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788623042.167123:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3ccb8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788623042.167191:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e3ccb9800 for lustre-OST0000 00010000:00010000:2.0:1788623042.476960:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788623043.211972:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788623043.211982:0:7614:0:(genops.c:885:class_export_put()) final put ffff997e37394000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788623043.212122:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e37394000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788623043.212182:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e07345800 for lustre-OST0001 00010000:00010000:0.0:1788623043.500315:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788623043.630210:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) b1f47098-4bf9-4547-81bd-f9d9ba5d3857->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788623043.630223:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) b1f47098-4bf9-4547-81bd-f9d9ba5d3857->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788623043.630227:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788623043.630248:0:12328:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788623043.630253:0:12328:0:(import.c:65:import_set_state_nolock()) ffff997e10367800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788623043.630261:0:12328:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 362 00000100:00080000:1.0:1788623043.630268:0:12328:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788623043.630276:0:12328:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff997e10367800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:1.0:1788623043.630316:0:12328:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a317800 x1875506866770432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623043.630722:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866770432:0@lo:38:kworker.0 00000400:00000100:2.0:1788623043.630801:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875506866770432 offset 0 length 520: 4 00000020:01000000:3.0:1788623043.948012:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e073b9a80 - data ffff997e41ec0798/ffff997e41d57400 00000020:01000000:3.0:1788623043.948181:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e032c3ae0 - data ffff997e25057870/ffff997d054ab000 00100000:10000000:3.0:1788623043.956461:0:13081:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788623043.993186:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6538 00000020:00000080:3.0:1788623043.993200:0:13081:0:(genops.c:885:class_export_put()) final put ffff997e24f0a000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788623043.993223:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e1026d000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788623043.993227:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e1026d000 2 00000020:01000004:3.0:1788623043.993246:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff997e1026d000 from lustre-OST0000 00000020:00000080:3.0:1788623043.993273:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788623043.993282:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788623043.993285:0:13081:0:(genops.c:885:class_export_put()) final put ffff997e083d1800/lustre-OST0000_UUID 00000020:00000080:3.0:1788623043.993288:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff997e083d1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788623043.993299:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788623043.993345:0:13081:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788623043.993349:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788623043.993353:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788623043.993358:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788623043.993364:0:13081:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff997d04f0d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788623043.993370:0:13081:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff997e06550000) has exports, disconnecting them 00000020:00080000:3.0:1788623043.993375:0:13081:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff997d04f0d800), last request at 1788622821 00000020:00000080:3.0:1788623043.993380:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6562 00000020:00080000:3.0:1788623043.993391:0:13081:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff997d04f0d800): rc 0 00000020:00000080:3.0:1788623043.993395:0:13081:0:(genops.c:885:class_export_put()) final put ffff997d04f0d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788623043.993611:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e24f0a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788623043.993624:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04f0d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788623043.997461:0:13081:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788623043.997481:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788623043.997487:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788623043.997494:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788623043.997888:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788623043.997898:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788623043.997905:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e1026d000 1 00000020:00000080:3.0:1788623043.997912:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d64f2 00000020:00000080:3.0:1788623043.998050:0:13081:0:(genops.c:885:class_export_put()) final put ffff997e07346000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788623043.998058:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788623043.998063:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788623043.998067:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788623043.998071:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff997e06130000) has no exports 00000020:00000080:2.0:1788623043.999341:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997d04f0b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788623043.999368:0:12328:0:(genops.c:885:class_export_put()) final put ffff997d04f0f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788623043.999371:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04f0f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788623043.999379:0:12328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788623043.999436:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e07346000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788623044.034081:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788623044.034098:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788623044.034105:0:13081:0:(genops.c:885:class_export_put()) final put ffff997e1026d800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788623044.034109:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff997e1026d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788623044.034122:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788623044.034268:0:13081:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff997e1026e000 00000020:02000400:2.0:1788623044.034321:0:13081:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788623044.527363:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623045.557329:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623046.572349:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788623046.637475:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) b1f47098-4bf9-4547-81bd-f9d9ba5d3857->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788623046.637496:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) b1f47098-4bf9-4547-81bd-f9d9ba5d3857->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788623046.637500:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788623046.637503:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1788623047.296476:0:13233:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788623047.318526:0:13233:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788623047.318621:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.318638:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.318647:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.318654:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.318678:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788623047.318683:0:13233:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788623047.318709:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788623047.318722:0:13233:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff997e3a317800 x1875506866770432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788623058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623047.318775:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788623047.318782:0:13233:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788623047.318788:0:13233:0:(import.c:65:import_set_state_nolock()) ffff997e10367800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788623047.318794:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788623047.318799:0:13233:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff997e3a317800 x1875506866770432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788623058 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788623047.318817:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623047.318826:0:7601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623047.318830:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788623047.318836:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:2.0:1788623047.318840:0:7601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bac000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788623047.318845:0:7601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.318855:0:7601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623047.318862:0:7601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623047.318868:0:7601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788623047.318870:0:7601:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788623047.318873:0:7601:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788623047.318897:0:7601:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff997e07f2e800 00010000:00010000:2.0:1788623047.318902:0:7601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.318909:0:7601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bac000/0xef842f43731d6706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d670d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623047.318914:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866770432:0@lo:38:kworker.0 00010000:00010000:2.0:1788623047.318923:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623047.318927:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623047.318929:0:7601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623047.323415:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323435:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323443:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323451:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323478:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623047.323485:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323492:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323498:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323504:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623047.323515:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788623047.323519:0:13233:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1788623047.323557:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:3.0:1788623047.323565:0:13233:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:2.0:1788623047.323566:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788623047.323572:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788623047.323578:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788623047.323579:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fae00 already unused, calling callback (ffffffffc1bcdc20) 00000020:00000080:3.0:1788623047.323586:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:2.0:1788623047.323586:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788623047.323593:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff997e2f1ecd40) has no exports 00010000:00010000:2.0:1788623047.323599:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623047.323610:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623047.323615:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788623047.323618:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788623047.323621:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:3.0:1788623047.323634:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff997e2f1ecd40) has no exports 00010000:00010000:2.0:1788623047.323636:0:5797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff997e07f2e800 00010000:00010000:2.0:1788623047.323642:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.323661:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e013fae00/0xef842f43731d6714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d671b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.323676:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623047.323679:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.323685:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e08bace00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:2.0:1788623047.323688:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.323695:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788623047.323702:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623047.323721:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788623047.323723:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788623047.323725:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788623047.323730:0:5797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff997e07f2e800 00010000:00010000:2.0:1788623047.323733:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.323773:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bace00/0xef842f43731d6952 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d6959 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623047.323787:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623047.323789:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623047.323796:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623047.329258:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788623047.331026:0:13233:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e073b9b40 - data ffff997e41ec01b0/ffff997e41d57800 00000020:01000000:3.0:1788623047.331195:0:13233:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff997e064ce540 - data ffff997e41e651b0/ffff997e374bfc00 00100000:10000000:3.0:1788623047.347092:0:13233:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788623047.435381:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d6603 00000020:00000080:1.0:1788623047.435557:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e1021a800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788623047.435575:0:13233:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e3ccbd000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788623047.435589:0:13233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e3ccbd000 2 00000020:01000004:1.0:1788623047.435592:0:13233:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff997e3ccbd000 from lustre-OST0001 00000020:00000080:2.0:1788623047.435622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e1021a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788623047.435717:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788623047.435727:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788623047.435731:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e1021b800/lustre-OST0001_UUID 00000020:00000080:1.0:1788623047.435733:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff997e1021b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788623047.435739:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788623047.435843:0:13233:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b1f47098-4bf9-4547-81bd-f9d9ba5d3857->MGS 00010000:00010000:1.0:1788623047.435861:0:13233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788623047.435872:0:13233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623047.435880:0:13233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788623047.435883:0:13233:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788623047.435886:0:13233:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788623047.435900:0:13233:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff997e07f2e800 00010000:00010000:1.0:1788623047.435904:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e08bac400/0xef842f43731d6515 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d651c expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623047.435943:0:13233:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788623047.435950:0:13233:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623047.435955:0:13233:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788623047.435958:0:13233:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788623047.435959:0:13233:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788623047.435970:0:13233:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff997e07f2e800 00010000:00010000:1.0:1788623047.435973:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e07285a00/0xef842f43731d6761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xef842f43731d6768 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788623047.435989:0:13233:0:(import.c:65:import_set_state_nolock()) ffff997e07f2e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788623047.435992:0:13233:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788623047.435995:0:13233:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788623047.435997:0:13233:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788623047.436001:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788623047.436012:0:13233:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff997e3a315c00 x1875506866770304/t0(0) o250->MGC192.168.204.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788623051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788623047.436033:0:13233:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788623047.436036:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1788623047.436118:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b1f47098-4bf9-4547-81bd-f9d9ba5d3857:3277:1875506866770304:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1788623047.436167:0:13233:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788623047.436204:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d63f6 00000020:00000080:1.0:1788623047.436209:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e0996a800/b1f47098-4bf9-4547-81bd-f9d9ba5d3857 00000020:01000000:1.0:1788623047.436225:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.119@tcp (flags='') 00000020:00000080:1.0:1788623047.436229:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788623047.436233:0:13233:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788623047.436236:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff997e06120000) has no exports 00000020:00000080:2.0:1788623047.436292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff997e0996a800/b1f47098-4bf9-4547-81bd-f9d9ba5d3857 for MGC192.168.204.119@tcp 10000000:01000000:2.0:1788623047.436826:0:5806:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788623047.436973:0:13233:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.119@tcp: client import never connected 00000100:00080000:1.0:1788623047.436983:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788623047.436985:0:13233:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788623047.436988:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788623047.436990:0:13233:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788623047.437026:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788623047.437031:0:13233:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.119@tcp (uuid b1f47098-4bf9-4547-81bd-f9d9ba5d3857) 00000020:01000000:1.0:1788623047.437036:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788623047.437039:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788623047.437042:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788623047.437047:0:13233:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff997e24f7f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788623047.437052:0:13233:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff997e078599c0) has exports, disconnecting them 00000020:00080000:1.0:1788623047.437057:0:13233:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff997e24f7f000), last request at 1788622841 00000020:00000080:1.0:1788623047.437061:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d662d 00000020:00080000:1.0:1788623047.437070:0:13233:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff997e24f7f000): rc 0 00000020:00000080:1.0:1788623047.437074:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e24f7f000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788623047.437151:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e07f2e800 for MGC192.168.204.119@tcp 00000020:00000080:0.0:1788623047.437157:0:12328:0:(genops.c:885:class_export_put()) final put ffff997e07f29000/b1f47098-4bf9-4547-81bd-f9d9ba5d3857 00000020:00000080:0.0:1788623047.437159:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e07f29000/b1f47098-4bf9-4547-81bd-f9d9ba5d3857 for MGC192.168.204.119@tcp 00000020:01000000:0.0:1788623047.437166:0:12328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.119@tcp (b1f47098-4bf9-4547-81bd-f9d9ba5d3857) 00000020:00000080:0.0:1788623047.442106:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e24f7f000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788623047.445455:0:13233:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788623047.445465:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788623047.445469:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788623047.445478:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788623047.445735:0:12328:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff997e10367800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788623047.445880:0:7601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788623047.448590:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788623047.449503:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788623047.450018:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff997e07984a00:5792] 0 exiting: rc = 1 00000100:00100000:0.0:1788623047.450090:0:11633:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff997e03e60000:11633] 2 exiting: rc = 0 00000100:00100000:2.0:1788623047.450310:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff997e07984600:5793] 1 exiting: rc = 0 00000100:00100000:0.0:1788623047.450537:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788623047.450826:0:7602:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff997e3738be00:7602] 3 exiting: rc = 0 00000100:00100000:0.0:1788623047.450826:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff997e07f30800:5795] 1 exiting: rc = 0 00000100:00100000:2.0:1788623047.450951:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff997e07f31800:5796] 2 exiting: rc = 0 00000100:00100000:2.0:1788623047.451901:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff997e07f31e00:5794] 0 exiting: rc = 1 00000100:00100000:0.0:1788623047.452114:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452121:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452126:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452133:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452138:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452143:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452148:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452154:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452160:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452165:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452171:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452176:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452181:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452186:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452191:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452197:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452204:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452209:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452214:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452219:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452224:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452229:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452234:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452239:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452244:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452249:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452253:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452257:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452261:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452266:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452270:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452277:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452297:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452303:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452308:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452313:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452317:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452322:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452326:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452331:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452336:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452340:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452345:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452349:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452353:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452357:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452362:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452366:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452371:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452375:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452379:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452384:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452388:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452392:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452396:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452400:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452404:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452408:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.452413:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.453801:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.453821:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.453827:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.453834:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.453839:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788623047.464607:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623047.464626:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788623047.465515:0:13233:0:(genops.c:885:class_export_put()) final put ffff997d04f0f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788623047.465539:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff997d04f0f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788623047.465553:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788623047.465609:0:13233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e3ccbd000 1 00000020:00000080:0.0:1788623047.465615:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xef842f43731d65d2 00000020:00000080:0.0:1788623047.465624:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e1021f800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788623047.465658:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788623047.465664:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623047.465669:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788623047.465674:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff997e102319c0) has no exports 00000020:00000080:2.0:1788623047.466064:0:12328:0:(genops.c:844:class_export_destroy()) destroying export ffff997e1021f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788623047.510917:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623047.510945:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788623047.510951:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e3ccbc000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788623047.510956:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff997e3ccbc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788623047.510968:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788623047.511166:0:13233:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff997e3ccbe800 00000020:01000000:0.0:1788623047.511187:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788623047.511192:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788623047.511197:0:13233:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788623047.511201:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff997e061219c0) has no exports 00000020:00000080:0.0:1788623047.511242:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788623047.511248:0:13233:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788623047.511251:0:13233:0:(genops.c:885:class_export_put()) final put ffff997e07340000/OSS_uuid 00000020:00000080:0.0:1788623047.511254:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff997e07340000/OSS_uuid for OSS 00000020:01000000:0.0:1788623047.511258:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788623047.511328:0:6657:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff997e08874400:6657] 2 exiting: rc = 0 00000100:00080000:3.0:1788623047.513226:0:5805:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788623047.513367:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff997e08874a00:6656] 1 exiting: rc = 0 00000100:00100000:3.0:1788623047.513419:0:6655:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff997e06ef7800:6655] 0 exiting: rc = 1 00000100:00100000:2.0:1788623047.516307:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff997e39a4de00:8422] 3 exiting: rc = 0 00000100:00100000:0.0:1788623047.518312:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518339:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518346:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518354:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518359:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518364:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518370:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518375:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518397:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518402:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518408:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518425:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518431:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518437:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518443:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518448:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518454:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518459:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518465:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518472:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518478:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518484:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518489:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518495:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518501:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518506:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518511:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518516:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518521:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518527:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518532:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518537:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518542:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518548:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518554:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518560:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518565:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518571:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518577:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518583:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518588:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518594:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518599:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518612:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518617:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518622:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518627:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518632:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518637:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518643:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518648:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518653:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518658:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518663:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518668:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518673:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518680:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518685:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518690:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518695:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518700:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518706:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518711:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.518716:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.520818:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff997e07985a00:6658] 0 exiting: rc = 1 00000100:00100000:2.0:1788623047.521272:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff997e06edd400:6659] 1 exiting: rc = 0 00000100:00100000:0.0:1788623047.521431:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521453:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521459:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521466:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521471:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521476:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521482:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521487:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521492:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521497:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521502:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521508:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521513:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521533:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521539:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521544:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521550:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521556:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521561:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521567:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521572:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521578:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521584:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521589:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521594:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521600:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521606:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521611:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521617:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521622:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521628:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521633:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521640:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521645:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521650:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521656:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521661:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521667:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521673:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521679:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521684:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521700:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521706:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521711:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521716:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521722:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521727:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521732:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521766:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521786:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521793:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521799:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521803:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521808:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521813:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521820:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521825:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521830:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521834:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521839:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521844:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521850:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521854:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.521859:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788623047.525099:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff997e09426c00:6661] 1 exiting: rc = 0 00000100:00100000:3.0:1788623047.526869:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff997e09427800:6660] 0 exiting: rc = 1 00000100:00100000:0.0:1788623047.556621:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff997e065af800:6662] 2 exiting: rc = 0 00000100:00100000:0.0:1788623047.556800:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556808:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556815:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556821:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556826:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556833:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556840:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556847:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556853:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556859:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556865:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556870:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556876:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556881:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556887:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556893:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556900:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556906:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556928:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556946:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556952:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556957:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556964:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556969:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556974:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556979:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556984:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556989:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556993:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.556998:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557003:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557021:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557028:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557033:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557039:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557045:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557051:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557057:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557062:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557068:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557073:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557079:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557084:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557089:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557094:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557099:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557104:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557109:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557114:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557120:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557126:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557131:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557136:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557149:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557154:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557161:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557166:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557171:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557177:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557183:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557189:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557195:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557200:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.557214:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564637:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff997e39a12e00:6664] 1 exiting: rc = 0 00000100:00100000:0.0:1788623047.564796:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff997e39a13400:6663] 0 exiting: rc = 1 00000100:00100000:0.0:1788623047.564855:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564862:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564867:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564874:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564879:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564885:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564890:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564896:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564901:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564906:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564912:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564917:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564923:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564928:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564946:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564951:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564956:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.564961:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565022:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565028:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565034:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565039:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565059:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565064:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565070:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565075:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565080:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565086:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565092:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565098:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565103:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565109:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565115:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565121:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565127:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565132:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565138:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565143:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565150:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565156:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565161:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565167:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565173:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565179:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565185:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565190:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565196:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565201:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565207:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565214:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565219:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565225:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565242:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565248:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565254:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565260:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565265:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565280:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565286:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565291:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565297:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565303:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565309:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.565322:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788623047.566284:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff997e39a07400:6665] 0 exiting: rc = 1 00000100:00100000:1.0:1788623047.566363:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff997e0606b400:6666] 1 exiting: rc = 0 00000100:00100000:0.0:1788623047.566538:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566544:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566551:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566557:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566565:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566571:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566602:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566609:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566615:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566622:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566629:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566635:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566642:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566648:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566655:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566660:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566666:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566672:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566693:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566701:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566707:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566714:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566722:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566729:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566735:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566760:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566768:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566775:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566792:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566799:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566821:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566828:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566836:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566843:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566849:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566856:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566863:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566870:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566877:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566884:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566890:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566895:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566918:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566926:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566941:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566948:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566954:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566960:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566966:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566972:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566978:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566985:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.566994:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567000:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567023:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567030:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567036:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567041:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567047:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567053:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567058:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567064:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567077:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788623047.567100:0:13233:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788623047.578638:0:13233:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788623066.608438:0:13847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788623075.404818:0:14308:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788623075.404826:0:14308:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788623075.404942:0:14308:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff997e36e26000 00000020:01000004:3.0:1788623075.404959:0:14308:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788623075.404967:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788623075.404983:0:14308:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff997e2f1eb380) 00000020:00000080:3.0:1788623075.404998:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788623075.435986:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788623075.443958:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788623075.444322:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 543: rc = 0 00100000:10000000:3.0:1788623075.444473:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 543: rc = 0 00100000:10000000:3.0:1788623075.444615:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 543: rc = 0 00100000:10000000:3.0:1788623075.444711:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 543: rc = 0 00100000:10000000:3.0:1788623075.447051:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788623075.447354:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 543: rc = 0 00100000:10000000:3.0:1788623075.447506:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 543: rc = 0 00100000:10000000:3.0:1788623075.448106:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 545: rc = 0 00100000:10000000:3.0:1788623075.450404:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 424: rc = 0 00100000:10000000:3.0:1788623075.450600:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 424: rc = 0 00100000:10000000:3.0:1788623075.451489:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:3.0:1788623075.452336:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1788623075.453005:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1788623075.453461:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 640: rc = 0 00100000:10000000:3.0:1788623075.454065:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1788623075.454692:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:3.0:1788623075.455333:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 640: rc = 0 00100000:10000000:3.0:1788623075.455961:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1788623075.456379:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1788623075.457033:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1788623075.457338:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1788623075.457622:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 640: rc = 0 00100000:10000000:3.0:1788623075.458099:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 437: rc = 0 00100000:10000000:3.0:1788623075.458365:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 437: rc = 0 00100000:10000000:3.0:1788623075.458615:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 437: rc = 0 00100000:10000000:3.0:1788623075.458875:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 437: rc = 0 00100000:10000000:3.0:1788623075.459111:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 437: rc = 0 00100000:10000000:3.0:1788623075.459384:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 437: rc = 0 00100000:10000000:3.0:1788623075.459648:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 437: rc = 0 00100000:10000000:3.0:1788623075.462057:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 437: rc = 0 00100000:10000000:3.0:1788623075.463149:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 437: rc = 0 00100000:10000000:3.0:1788623075.463456:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 437: rc = 0 00100000:10000000:3.0:1788623075.463854:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 437: rc = 0 00100000:10000000:3.0:1788623075.464106:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 437: rc = 0 00100000:10000000:3.0:1788623075.464363:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 437: rc = 0 00100000:10000000:3.0:1788623075.464630:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 437: rc = 0 00100000:10000000:3.0:1788623075.464902:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 437: rc = 0 00100000:10000000:3.0:1788623075.465148:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 437: rc = 0 00100000:10000000:3.0:1788623075.466649:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 437: rc = 0 00100000:10000000:3.0:1788623075.468377:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 437: rc = 0 00100000:10000000:3.0:1788623075.468644:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 437: rc = 0 00100000:10000000:3.0:1788623075.469316:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 437: rc = 0 00100000:10000000:3.0:1788623075.469665:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 437: rc = 0 00100000:10000000:3.0:1788623075.469996:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 437: rc = 0 00100000:10000000:3.0:1788623075.470307:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 437: rc = 0 00100000:10000000:3.0:1788623075.470590:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 437: rc = 0 00100000:10000000:3.0:1788623075.470871:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 437: rc = 0 00100000:10000000:3.0:1788623075.472593:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 437: rc = 0 00100000:10000000:2.0:1788623075.475476:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 437: rc = 0 00100000:10000000:2.0:1788623075.476004:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 437: rc = 0 00100000:10000000:2.0:1788623075.476505:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 437: rc = 0 00100000:10000000:2.0:1788623075.478403:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 437: rc = 0 00100000:10000000:2.0:1788623075.478739:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 437: rc = 0 00100000:10000000:2.0:1788623075.479372:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 437: rc = 0 00100000:10000000:2.0:1788623075.479730:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 647: rc = 0 00100000:10000000:2.0:1788623075.480624:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788623075.480871:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 425: rc = 0 00100000:10000000:2.0:1788623075.481048:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788623075.481300:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 425: rc = 0 00100000:10000000:2.0:1788623075.481493:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788623075.481547:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 425: rc = 0 00100000:10000000:2.0:1788623075.482474:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788623075.482566:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 610: rc = 0 00100000:10000000:2.0:1788623075.482792:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788623075.482863:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 610: rc = 0 00100000:10000000:2.0:1788623075.483072:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788623075.483644:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 610: rc = 0 00000020:00000080:2.0:1788623075.484023:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788623075.484032:0:14308:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788623075.484043:0:14308:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d76f7 00000020:01000004:2.0:1788623075.484051:0:14308:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788623075.484055:0:14308:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788623075.484061:0:14308:0:(tgt_mount.c:101:server_register_mount()) register mount ffff997e36e26000 from MGS 00000020:01000004:2.0:1788623075.484065:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788623075.484074:0:14308:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff997e10230000) 00000020:00000080:2.0:1788623075.484084:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788623075.484369:0:14308:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e36e26000 from MGS, refs=2 00080000:01000000:2.0:1788623075.484375:0:14308:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788623075.484380:0:14308:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d7705 00000100:00100000:2.0:1788623075.484492:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788623075.484624:0:14308:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788623075.484629:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788623075.486491:0:14308:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788623075.486504:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788623075.490589:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.490936:0:14308:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788623075.490943:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788623075.492231:0:14308:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788623075.492245:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788623075.492790:0:14308:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788623075.492797:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788623075.494565:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623075.494571:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623075.494573:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623075.495437:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623075.495441:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623075.495443:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623075.496698:0:14308:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788623075.500677:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788623075.517071:0:14308:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788623075.517318:0:14308:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788623075.517321:0:14308:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788623075.519470:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788623075.519663:0:14308:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788623075.519786:0:14308:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788623075.520306:0:14308:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788623075.520641:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.520844:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788623075.520850:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788623075.526386:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788623075.526415:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788623075.527032:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788623075.527040:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788623075.535795:0:14322:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788623075.535924:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788623075.535946:0:14308:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.119@tcp' 00000020:01000004:1.0:1788623075.535948:0:14308:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788623075.535978:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.119@tcp (typ=mgc) 00000020:00000080:1.0:1788623075.535990:0:14308:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.119@tcp (ffff997d04c499c0) 00000020:00000080:1.0:1788623075.536007:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788623075.536087:0:14308:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e3a2e2000@MGC192.168.204.119@tcp: add connection 192.168.204.119@tcp at head 00010000:00010000:1.0:1788623075.536249:0:14308:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.119@tcp-0 is initialized 00000040:01000000:1.0:1788623075.536256:0:14308:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788623075.537879:0:14323:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788623075.537974:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.119@tcp (uuid dd2d9f5a-a1d8-466a-ac20-a19462995af0) 00000020:00000080:1.0:1788623075.537995:0:14308:0:(genops.c:1385:class_connect()) connect: client dd2d9f5a-a1d8-466a-ac20-a19462995af0, cookie 0xef842f43731d7713 00000100:00080000:1.0:1788623075.538008:0:14308:0:(import.c:545:import_select_connection()) MGC192.168.204.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788623075.538015:0:14308:0:(import.c:665:import_select_connection()) MGC192.168.204.119@tcp: import ffff997e3a2e2000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:1.0:1788623075.538048:0:14308:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a315180 x1875506866770560/t0(0) o250->MGC192.168.204.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788623075.538076:0:14308:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd2d9f5a-a1d8-466a-ac20-a19462995af0->MGS 00000100:00100000:0.0:1788623075.538237:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3277:1875506866770560:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788623075.538309:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623075.538386:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866770560 00000100:00100000:0.0:1788623075.538406:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866770560 00000100:00100000:0.0:1788623075.538438:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788623075.538445:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875506866770560:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788623075.538471:0:14318:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from dd2d9f5a-a1d8-466a-ac20-a19462995af0@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:0.0:1788623075.538495:0:14318:0:(genops.c:1385:class_connect()) connect: client dd2d9f5a-a1d8-466a-ac20-a19462995af0, cookie 0xef842f43731d771a 00000100:00080000:0.0:1788623075.538619:0:14318:0:(import.c:65:import_set_state_nolock()) ffff997d079fa000 : changing import state from RECOVER to FULL 00000020:01000004:1.0:1788623075.538711:0:14308:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788623075.538719:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788623075.538735:0:14308:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff997d04c48000) 00000020:00000080:1.0:1788623075.538780:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788623075.538975:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+5:3277:x1875506866770560:12345-0@lo:250:mount.lustre.0 Request processed in 528us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623075.538983:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788623075.539049:0:3277:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788623075.539059:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.119@tcp: connect to target with instance 0 00000100:00080000:0.0:1788623075.539066:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788623075.539070:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788623075.539073:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e3a2e2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788623075.539076:0:3277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788623075.539084:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788623075.539089:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3277:1875506866770560:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788623075.562472:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788623075.563801:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788623075.563811:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788623075.565723:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788623075.565737:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788623075.569436:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788623075.569451:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788623075.570379:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.570565:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788623075.570570:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788623075.571913:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788623075.571923:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788623075.608196:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.608424:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788623075.608431:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788623075.609698:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788623075.609708:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788623075.610311:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.610493:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788623075.610498:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788623075.611024:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788623075.611031:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788623075.611507:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.611662:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788623075.611667:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788623075.612204:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788623075.612211:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788623075.612712:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.613030:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788623075.613036:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788623075.614009:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788623075.614024:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788623075.634289:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623075.634553:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788623075.634559:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788623075.636680:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788623075.636693:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788623075.637612:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788623075.637702:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788623075.638867:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788623075.638900:0:14308:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788623075.638907:0:14308:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788623075.639048:0:14308:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788623075.639081:0:14308:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.119@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788623075.639085:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788623075.639087:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788623075.639088:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788623075.639093:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788623075.639095:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788623075.639096:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788623075.639097:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788623075.639099:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788623075.639101:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788623075.639102:0:14308:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788623075.639104:0:14308:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788623075.639106:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788623075.639107:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788623075.639108:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788623075.639109:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788623075.639110:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788623075.639110:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788623075.639111:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788623075.639222:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788623075.639225:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788623075.639226:0:14308:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788623075.639267:0:14308:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788623075.639287:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866770688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788623075.639357:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.639474:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788623075.639518:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866770688 00000100:00100000:3.0:1788623075.639526:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866770688 00000100:00100000:3.0:1788623075.639574:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788623075.639584:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+5:14308:x1875506866770688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788623075.639916:0:14321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788623075.639920:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788623075.639923:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788623075.640315:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788623075.640915:0:14321:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788623075.643409:0:14343:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788623075.643422:0:14343:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788623075.643425:0:14343:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788623075.643460:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788623075.643927:0:14321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788623075.643940:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788623075.654566:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+5:14308:x1875506866770688:12345-0@lo:253:mount.lustre.0 Request processed in 14973us (15197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.654589:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623075.654838:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866770688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788623075.654856:0:14308:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788623075.654860:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788623075.654862:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788623075.654863:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623075.654865:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623075.654866:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623075.654867:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623075.654869:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788623075.654870:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788623075.654871:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623075.654873:0:14308:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788623075.654892:0:14308:0:(tgt_mount.c:101:server_register_mount()) register mount ffff997e36e26000 from lustre-MDT0000 10000000:01000000:0.0:1788623075.654919:0:14308:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788623075.654922:0:14308:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788623075.654926:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff997d04c499c0 10000000:01000000:0.0:1788623075.654930:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788623075.654938:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff997d04c499c0 from 1 10000000:01000000:0.0:1788623075.654941:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788623075.654981:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.654992:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.655017:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623075.655040:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866770816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788623075.655081:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.655477:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e081793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623075.655519:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866770816 00000100:00100000:2.0:1788623075.655532:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866770816 00000100:00100000:2.0:1788623075.655604:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623075.655613:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+5:14308:x1875506866770816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623075.655636:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623075.655650:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fb800/0xef842f43731d772f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7728 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.655672:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fb800/0xef842f43731d772f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7728 expref: 6 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.655683:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fb800/0xef842f43731d772f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7728 expref: 6 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.655692:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fb800, rc 0) 00000100:00100000:2.0:1788623075.655735:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+6:14308:x1875506866770816:12345-0@lo:101:mount.lustre.0 Request processed in 122us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623075.655764:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788623075.655838:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866770816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788623075.655852:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.655862:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623075.655924:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866770944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623075.655951:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.656382:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788623075.656472:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866770944 00000100:00100000:0.0:1788623075.656478:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866770944 00000100:00100000:0.0:1788623075.656508:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788623075.656515:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+6:14308:x1875506866770944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623075.656792:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+6:14308:x1875506866770944:12345-0@lo:501:mount.lustre.0 Request processed in 277us (839us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788623075.656799:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788623075.657006:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866770944:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788623075.657038:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788623075.657054:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657062:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623075.657072:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff997e36e26000 10000000:01000000:1.0:1788623075.657097:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788623075.657102:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff997e36e26000 10000000:01000000:1.0:1788623075.657105:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788623075.657109:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff997e36e26000 from 1 10000000:01000000:1.0:1788623075.657120:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788623075.657145:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657153:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657162:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623075.657176:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788623075.657210:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.657229:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788623075.657400:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866771072 00000100:00100000:0.0:1788623075.657405:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866771072 00000100:00100000:0.0:1788623075.657428:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788623075.657435:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+6:14308:x1875506866771072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623075.657443:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623075.657454:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9600/0xef842f43731d773d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7736 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.657471:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9600/0xef842f43731d773d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7736 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.657480:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9600/0xef842f43731d773d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7736 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.657488:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9600, rc 0) 00000100:00100000:0.0:1788623075.657530:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+7:14308:x1875506866771072:12345-0@lo:101:mount.lustre.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623075.657536:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788623075.657687:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788623075.657702:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d773d expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657710:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d773d expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623075.657722:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788623075.657738:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d773d expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657772:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e2f0dae00/0xef842f43731d7736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d773d expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623075.657779:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788623075.657783:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788623075.657788:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff997e36e26000 10000000:01000000:1.0:1788623075.657791:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788623075.657794:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788623075.657796:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788623075.657810:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657816:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.657823:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623075.657843:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788623075.657868:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.657879:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623075.657939:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866771200 00000100:00100000:2.0:1788623075.657944:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866771200 00000100:00100000:2.0:1788623075.657966:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788623075.657973:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+7:14308:x1875506866771200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623075.657981:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623075.657990:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fb200/0xef842f43731d774b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7744 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.658003:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fb200/0xef842f43731d774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7744 expref: 8 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.658011:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fb200/0xef842f43731d774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7744 expref: 8 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.658025:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fb200, rc 0) 00000100:00100000:2.0:1788623075.658349:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+8:14308:x1875506866771200:12345-0@lo:101:mount.lustre.0 Request processed in 375us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623075.658356:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788623075.658480:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788623075.658493:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d774b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.658501:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d774b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623075.658545:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623075.658570:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.658696:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788623075.658735:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866771328 00000100:00100000:0.0:1788623075.658739:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866771328 00000100:00100000:1.0:1788623075.658980:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788623075.658989:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+8:14308:x1875506866771328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623075.659518:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14308:x1875506866771328:12345-0@lo:501:mount.lustre.0 Request processed in 530us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.659526:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788623075.659598:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623075.659644:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788623075.659689:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623075.660502:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788623075.660712:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866771456 00000100:00100000:2.0:1788623075.660721:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866771456 00000100:00100000:2.0:1788623075.660776:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788623075.660785:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14308:x1875506866771456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788623075.662561:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14308:x1875506866771456:12345-0@lo:503:mount.lustre.0 Request processed in 1769us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623075.662575:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788623075.662801:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866771456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788623075.663530:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd03100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14344:1875506866771584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788623075.663584:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623075.663727:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788623075.663949:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866771584 00000100:00100000:2.0:1788623075.663956:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866771584 00000100:00100000:3.0:1788623075.665354:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788623075.665366:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14344:x1875506866771584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788623075.665976:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14344:x1875506866771584:12345-0@lo:502:llog_process_th.0 Request processed in 610us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.665984:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788623075.666320:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd03100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14344:1875506866771584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788623075.666437:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788623075.666449:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.666451:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788623075.666457:0:14344:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788623075.666460:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788623075.666474:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff997e2f1e99c0) 00000020:00000080:3.0:1788623075.666490:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788623075.666495:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788623075.666567:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788623075.666574:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d7759 00000020:00000080:3.0:1788623075.666991:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788623075.666996:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788623075.667000:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.667002:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788623075.667005:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788623075.667009:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.667010:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788623075.667022:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788623075.667030:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff997e2f1e8000) 00000020:00000080:3.0:1788623075.667040:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788623075.667043:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788623075.667045:0:14344:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788623075.667049:0:14344:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788623075.667054:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788623075.667220:0:14344:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e36e26000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788623075.667233:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff997e2f1ecd40) 00000020:00000080:3.0:1788623075.667242:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788623075.667299:0:14344:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788623075.667304:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d776e 00000020:00000080:3.0:1788623075.667401:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788623075.667407:0:14344:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788623075.667411:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xef842f43731d7775 00080000:01000000:3.0:1788623075.667416:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788623075.667419:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d777c 00010000:00010000:3.0:1788623075.757299:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788623075.758062:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1788623075.760525:0:14344:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788623075.761858:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff997e10234d40) 00000020:00000080:2.0:1788623075.761879:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788623075.761943:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788623075.761950:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d778a 00000020:00000080:3.0:1788623075.771436:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788623075.780377:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xef842f43731d7791 00000020:00000080:3.0:1788623075.780800:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788623075.780810:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788623075.780816:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.780818:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788623075.780821:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788623075.780828:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.780829:0:14344:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788623075.780833:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788623075.780865:0:14344:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788623075.780877:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788623075.780879:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.780880:0:14344:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788623075.780883:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788623075.780890:0:14344:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788623075.780892:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788623075.780893:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788623075.780895:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788623075.780898:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.780899:0:14344:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788623075.780901:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788623075.780904:0:14344:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788623075.780907:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.780908:0:14344:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788623075.780911:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788623075.780916:0:14344:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.119@tcp to nid 0x20000c0a8cc77 (192.168.204.119@tcp) 00000020:01000000:3.0:1788623075.780943:0:14344:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788623075.780946:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788623075.780959:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff997e06550000) 00000020:00000080:3.0:1788623075.780972:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788623075.780976:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788623075.781025:0:14344:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788623075.781031:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788623075.781036:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d779f 00010000:00080000:3.0:1788623075.781065:0:14344:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997d05d7d800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.119@tcp at head 00010000:00010000:3.0:1788623075.781300:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788623075.781614:0:14344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788623075.781665:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788623075.782648:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788623075.782711:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788623075.782857:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788623075.788521:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788623075.788531:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788623075.789633:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788623075.789648:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788623075.789683:0:14344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788623075.789703:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d77a6 00000100:00080000:2.0:1788623075.789714:0:14344:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788623075.789720:0:14344:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff997d05d7d800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:2.0:1788623075.789802:0:14344:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2eec8700 x1875506866771712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788623075.789888:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866771712:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788623075.789948:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875506866771712 offset 0 length 520: 4 00000100:00080000:2.0:1788623075.790019:0:14344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788623075.790072:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788623075.790077:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.790079:0:14344:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788623075.790082:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788623075.790099:0:14344:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788623075.790102:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788623075.790103:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788623075.790105:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788623075.790108:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.790109:0:14344:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788623075.790112:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788623075.790116:0:14344:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788623075.790120:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.790121:0:14344:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788623075.790124:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788623075.790127:0:14344:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.119@tcp to nid 0x20000c0a8cc77 (192.168.204.119@tcp) 00000020:01000000:2.0:1788623075.790149:0:14344:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788623075.790152:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788623075.790163:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff997e10233380) 00000020:00000080:2.0:1788623075.790174:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788623075.790177:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788623075.790247:0:14344:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788623075.790253:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788623075.790259:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xef842f43731d77b4 00010000:00080000:2.0:1788623075.790287:0:14344:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e116ae000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.119@tcp at head 00010000:00010000:2.0:1788623075.790501:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788623075.790689:0:14344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788623075.790711:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788623075.791243:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788623075.791316:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788623075.791411:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788623075.792346:0:14350:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788623075.792352:0:14350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788623075.793041:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788623075.793052:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788623075.793282:0:14344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788623075.793309:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d77bb 00000100:00080000:0.0:1788623075.793324:0:14344:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788623075.793331:0:14344:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e116ae000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:0.0:1788623075.793366:0:14344:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2ecbd880 x1875506866771840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788623075.795372:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866771840:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788623075.795450:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875506866771840 offset 0 length 520: 4 00000100:00080000:1.0:1788623075.796056:0:14344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788623075.796320:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623075.796327:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623075.796330:0:14344:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788623075.796334:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623075.796338:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623075.796340:0:14344:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788623075.796343:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788623075.796345:0:14344:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788623075.796347:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623075.796349:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623075.796351:0:14344:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788623075.796353:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623075.796355:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623075.796356:0:14344:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788623075.796360:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788623075.796420:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14344:1875506866771968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.796478:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.796595:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623075.797833:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866771968 00000100:00100000:2.0:1788623075.797846:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866771968 00000100:00100000:2.0:1788623075.797890:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788623075.797897:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14344:x1875506866771968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788623075.798873:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14344:x1875506866771968:12345-0@lo:502:llog_process_th.0 Request processed in 970us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623075.798885:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788623075.799110:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14344:1875506866771968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788623075.799154:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788623075.799161:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788623075.799163:0:14344:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788623075.799168:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788623075.799486:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788623075.799505:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788623075.799528:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d774b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.799540:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e2f0da800/0xef842f43731d7744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d774b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623075.799549:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e36e26000 from 1 10000000:01000000:2.0:1788623075.799552:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788623075.799587:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.799597:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.799607:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623075.799639:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788623075.799685:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.799720:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946540 going to sleep for 11 seconds 00000100:00100000:3.0:1788623075.799915:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772096 00000100:00100000:3.0:1788623075.799921:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772096 00000100:00100000:3.0:1788623075.799950:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788623075.799958:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+9:14308:x1875506866772096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788623075.799969:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623075.799984:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d77c2 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.800007:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d77c2 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.800017:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d77c2 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.800025:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735400, rc 0) 00000100:00100000:3.0:1788623075.800068:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+10:14308:x1875506866772096:12345-0@lo:101:mount.lustre.0 Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.800075:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788623075.801120:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623075.801144:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.801155:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623075.803041:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772224:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788623075.803283:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.803376:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946540 going to sleep for 11 seconds 00000100:00100000:0.0:1788623075.804866:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772224 00000100:00100000:0.0:1788623075.804879:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772224 00000100:00100000:0.0:1788623075.804959:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788623075.804971:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+10:14308:x1875506866772224:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788623075.804995:0:14321:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788623075.805003:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788623075.805127:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+10:14308:x1875506866772224:12345-0@lo:256:mount.lustre.0 Request processed in 160us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623075.805135:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788623075.805352:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772224:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788623075.805998:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788623075.806022:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.806034:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623075.806043:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e36e26000 from 1 10000000:01000000:2.0:1788623075.806046:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788623075.806093:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.806102:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.806176:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623075.806198:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788623075.806241:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.806272:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946540 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.807023:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772352 00000100:00100000:1.0:1788623075.807032:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772352 00000100:00100000:1.0:1788623075.807095:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788623075.807106:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+10:14308:x1875506866772352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788623075.807118:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623075.807136:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d77d0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.807160:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d77d0 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.807171:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d77d0 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.807194:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db000, rc 0) 00000100:00100000:1.0:1788623075.807256:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866772352:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.807262:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788623075.808350:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623075.808376:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623075.808516:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623075.808594:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623075.808719:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.808880:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946540 going to sleep for 11 seconds 00000100:00100000:3.0:1788623075.813784:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772480 00000100:00100000:3.0:1788623075.813798:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772480 00000100:00100000:3.0:1788623075.813849:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788623075.813858:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866772480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623075.814523:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866772480:12345-0@lo:501:mount.lustre.0 Request processed in 665us (5804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.814541:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788623075.815040:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623075.815105:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788623075.815151:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.815184:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946540 going to sleep for 11 seconds 00000100:00100000:3.0:1788623075.815349:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772608 00000100:00100000:3.0:1788623075.815355:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772608 00000100:00100000:3.0:1788623075.815410:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788623075.815418:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866772608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788623075.815586:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866772608:12345-0@lo:503:mount.lustre.0 Request processed in 167us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.815592:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788623075.815875:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788623075.816321:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14352:1875506866772736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788623075.816361:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.816410:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946480 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.816543:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772736 00000100:00100000:1.0:1788623075.816548:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772736 00000100:00100000:1.0:1788623075.816577:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788623075.816584:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14352:x1875506866772736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.816844:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14352:x1875506866772736:12345-0@lo:502:llog_process_th.0 Request processed in 260us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.816851:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788623075.817293:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14352:1875506866772736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788623075.817323:0:14352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788623075.817334:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.817336:0:14352:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788623075.817345:0:14352:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e36e26000 00000020:00000080:2.0:1788623075.817348:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788623075.817357:0:14352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788623075.817360:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.817361:0:14352:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788623075.817363:0:14352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788623075.817365:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.817366:0:14352:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788623075.817369:0:14352:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e36e26000 00000020:00000080:2.0:1788623075.817371:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788623075.817949:0:14352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788623075.817954:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.817956:0:14352:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788623075.817959:0:14352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788623075.817961:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623075.817962:0:14352:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788623075.817967:0:14352:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff997e36e26000 00000020:00000080:2.0:1788623075.817968:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788623075.818018:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14352:1875506866772864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788623075.818075:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623075.818123:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946480 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.822791:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772864 00000100:00100000:1.0:1788623075.822805:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772864 00000100:00100000:1.0:1788623075.822864:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788623075.822874:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14352:x1875506866772864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.823148:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14352:x1875506866772864:12345-0@lo:502:llog_process_th.0 Request processed in 274us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.823157:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788623075.823229:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14352:1875506866772864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788623075.823263:0:14352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623075.823272:0:14352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623075.823274:0:14352:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788623075.823279:0:14352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788623075.828815:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788623075.828850:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788623075.828881:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.828895:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623075.828948:0:14308:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788623075.828952:0:14308:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff997e36e26000 10000000:01000000:1.0:1788623075.828955:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff997e36e26000 10000000:01000000:1.0:1788623075.828959:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788623075.828965:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e36e26000 from 1 10000000:01000000:1.0:1788623075.828968:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788623075.829008:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.829016:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.829026:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623075.829051:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788623075.829118:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.829164:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.829190:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866772992 00000100:00100000:1.0:1788623075.829198:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866772992 00000100:00100000:1.0:1788623075.829238:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788623075.829247:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866772992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788623075.829259:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623075.829272:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e2f0da000/0xef842f43731d77e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d77de expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.829305:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e2f0da000/0xef842f43731d77e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d77de expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.829316:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e2f0da000/0xef842f43731d77e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d77de expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.829326:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da000, rc 0) 00000100:00100000:1.0:1788623075.829364:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14308:x1875506866772992:12345-0@lo:101:mount.lustre.0 Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.829371:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788623075.829432:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866772992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788623075.829447:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77e5 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.829457:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d77e5 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623075.829501:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866773120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623075.829526:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.829538:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788623075.829663:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773120 00000100:00100000:3.0:1788623075.829668:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773120 00000100:00100000:3.0:1788623075.829699:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788623075.829707:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14308:x1875506866773120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623075.829984:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14308:x1875506866773120:12345-0@lo:501:mount.lustre.0 Request processed in 277us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.829992:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788623075.830139:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866773120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623075.830169:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866773248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788623075.830210:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.830241:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788623075.830283:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773248 00000100:00100000:3.0:1788623075.830287:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773248 00000100:00100000:3.0:1788623075.830319:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788623075.830326:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14308:x1875506866773248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788623075.830479:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14308:x1875506866773248:12345-0@lo:503:mount.lustre.0 Request processed in 153us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.830487:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788623075.830558:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866773248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788623075.849592:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14355:1875506866773376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.849938:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.849979:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773376 00000100:00100000:1.0:1788623075.849986:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773376 00000100:00100000:1.0:1788623075.850817:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788623075.850833:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14355:x1875506866773376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.851112:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14355:x1875506866773376:12345-0@lo:502:llog_process_th.0 Request processed in 284us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.851120:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788623075.852280:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623075.852324:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14355:1875506866773376:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788623075.852420:0:14355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788623075.852436:0:14355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff997e078599c0) 00000020:00000080:0.0:1788623075.852456:0:14355:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788623075.852559:0:14355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e36e26000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788623075.852568:0:14355:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e36e26000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788623075.852571:0:14355:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e36e26000 4 00010000:00080000:0.0:1788623075.852601:0:14355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e3a3e7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.119@tcp at head 00010000:00010000:0.0:1788623075.854254:0:14355:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788623075.861602:0:14355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788623075.861720:0:14355:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788623075.861733:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xef842f43731d77f3 00000100:00080000:1.0:1788623075.861806:0:14355:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788623075.861814:0:14355:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff997e3a3e7000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:1.0:1788623075.861854:0:14355:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e3a314380 x1875506866773504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788623075.861892:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866773504:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788623075.861979:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.862053:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773504 00000100:00100000:1.0:1788623075.862060:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773504 00000100:00100000:1.0:1788623075.862090:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788623075.862098:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875506866773504:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788623075.862147:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875506866773504:12345-0@lo:38:llog_process_th.0 Request processed in 48us (168us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788623075.862154:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788623075.862186:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788623075.863726:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e3a3e7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788623075.863777:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788623075.863785:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866773504:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788623075.863820:0:14355:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788623075.864467:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14355:1875506866773632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.864539:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.864570:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773632 00000100:00100000:1.0:1788623075.864576:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773632 00000100:00100000:1.0:1788623075.864627:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788623075.864637:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14355:x1875506866773632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788623075.864915:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14355:x1875506866773632:12345-0@lo:502:llog_process_th.0 Request processed in 278us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.864923:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788623075.864971:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.864991:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14355:1875506866773632:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788623075.865014:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788623075.865126:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788623075.865143:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788623075.865163:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77e5 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.865174:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e2f0db200/0xef842f43731d77de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d77e5 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788623075.865232:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788623075.865235:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788623075.865240:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788623075.865241:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788623075.865243:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788623075.865244:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788623075.865245:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788623075.865247:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788623075.865248:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788623075.865249:0:14308:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788623075.865254:0:14308:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788623075.865256:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788623075.865257:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788623075.865258:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788623075.865259:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788623075.865260:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788623075.865261:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788623075.865262:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788623075.865264:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788623075.865264:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788623075.865265:0:14308:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788623075.865279:0:14308:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788623075.865288:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866773760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788623075.865319:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623075.865337:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.865354:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773760 00000100:00100000:1.0:1788623075.865358:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773760 00000100:00100000:1.0:1788623075.865395:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788623075.865401:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14308:x1875506866773760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788623075.865428:0:14321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788623075.865443:0:14321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788623075.917523:0:14321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788623075.917571:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788623075.923932:0:14342:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788623075.923946:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788623075.923977:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.923996:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d77c2 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.924006:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.924056:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d77c2 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623075.924073:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d77c2 expref: 12 pid: 14320 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623075.924100:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1875506866773888:0@lo:104: 00000100:00100000:0.0:1788623075.924448:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623075.924501:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08402cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788623075.924992:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866773888 00000100:00100000:1.0:1788623075.925002:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866773888 00000100:00100000:1.0:1788623075.925061:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788623075.925072:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14342:x1875506866773888:12345-0@lo:104: 00010000:00010000:1.0:1788623075.925098:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623075.925302:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788623075.925309:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14342:x1875506866773888:12345-0@lo:104: Request processed in 240us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623075.925317:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788623075.925925:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1875506866773888:0@lo:104: 00010000:00010000:0.0:1788623075.925948:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926340:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623075.926348:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926366:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fae00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788623075.926370:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926379:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788623075.926397:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788623075.926404:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788623075.926450:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926457:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788623075.926479:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926486:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e372fae00/0xef842f43731d77c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d77c9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926506:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623075.926508:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623075.926510:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623075.926552:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3278:1875506866774016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788623075.926602:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623075.926686:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774016 00000100:00100000:3.0:1788623075.926693:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774016 00010000:00010000:3.0:1788623075.926714:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d77c2 expref: 13 pid: 14320 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623075.926770:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788623075.926779:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+13:3278:x1875506866774016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623075.926791:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623075.926796:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d77c2 expref: 13 pid: 14320 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926807:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d77c2 expref: 13 pid: 14320 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926821:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735400/0xef842f43731d77c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d77c2 expref: 13 pid: 14320 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926834:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926841:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788623075.926855:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002911539s 00010000:00010000:3.0:1788623075.926859:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926866:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926873:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926880:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926891:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623075.926895:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926902:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926916:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.926925:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623075.926955:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:3278:x1875506866774016:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623075.926961:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788623075.926992:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3278:1875506866774016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623075.927010:0:14342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.927019:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623075.927026:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b8a00/0xef842f43731d77fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623075.929041:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14308:x1875506866773760:12345-0@lo:253:mount.lustre.0 Request processed in 63632us (63713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623075.929054:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788623075.929224:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14308:1875506866773760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788623075.929240:0:14308:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788623075.929243:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788623075.929245:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788623075.929246:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788623075.929247:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788623075.929248:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788623075.929249:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788623075.929250:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788623075.929251:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788623075.929253:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788623075.929254:0:14308:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788623075.929270:0:14308:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788623075.939440:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788623075.939929:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788623075.940437:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788623075.941364:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788623075.941945:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788623075.942471:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788623075.948240:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788623075.948451:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788623075.948827:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788623075.949067:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788623075.949331:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788623075.949509:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788623076.014981:0:14308:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788623076.016061:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788623076.016855:0:14365:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788623076.016860:0:14365:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788623076.016946:0:14366:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788623076.017042:0:14366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788623076.020997:0:14366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788623076.022362:0:14366:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788623076.022368:0:14366:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788623076.030554:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788623076.031415:0:14308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788623076.032643:0:14308:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788623076.032676:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788623076.032934:0:14308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788623076.039946:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788623076.041457:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788623076.041528:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788623076.045158:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788623076.060463:0:14308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788623076.129052:0:14308:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788623076.129259:0:14308:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa59d41d8b988 00100000:10000000:3.0:1788623076.129269:0:14308:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788623076.131585:0:14308:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788623076.131622:0:14308:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788623076.131637:0:14308:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788623076.131657:0:14308:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788623076.524271:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788623076.912396:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788623077.425562:0:14323:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788623077.425573:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e36e26000 from 6 10000000:01000000:0.0:1788623077.425580:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788623077.425643:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623077.425657:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623077.425671:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623077.425704:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866774144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788623077.425812:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623077.425876:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07e10a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788623077.425916:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774144 00000100:00100000:0.0:1788623077.425924:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774144 00000100:00100000:0.0:1788623077.425986:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788623077.425998:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14323:x1875506866774144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623077.426015:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623077.426031:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7801 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623077.426226:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7801 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623077.426253:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7801 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623077.426264:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8800, rc 0) 00000100:00100000:0.0:1788623077.426654:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866774144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 656us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623077.426662:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788623077.426727:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866774144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623077.426767:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623077.426778:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623077.426839:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866774272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788623077.426875:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623077.426906:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07e10a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788623077.427486:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774272 00000100:00100000:2.0:1788623077.427495:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774272 00000100:00100000:2.0:1788623077.427657:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788623077.427669:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866774272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788623077.427691:0:14321:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788623077.427710:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788623077.427714:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788623077.427843:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866774272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623077.427851:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788623077.429780:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866774272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788623077.429860:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788623077.429873:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623077.429887:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623077.548037:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788623077.932445:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788623078.571982:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623079.602519:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623080.627393:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788623081.016014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788623081.016022:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788623081.016025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788623081.016028:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788623081.016031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788623081.016034:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788623081.016037:0:8:0:(import.c:65:import_set_state_nolock()) ffff997e3a3e7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788623081.016050:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff997e3a3e7000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:2.0:1788623081.016073:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2eec8380 x1875506866774528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623081.016116:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3279:1875506866774400:0@lo:400:kworker.0 00000100:00100000:2.0:1788623081.016186:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623081.016249:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866774528:0@lo:38:kworker.0 00000100:00100000:2.0:1788623081.016294:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623081.016334:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774400 00000100:00100000:2.0:1788623081.016342:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774400 00000100:00100000:2.0:1788623081.016387:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788623081.016396:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:3279:x1875506866774400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623081.016442:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:3279:x1875506866774400:12345-0@lo:400:kworker.0 Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623081.016449:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788623081.016498:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3279:1875506866774400:0@lo:400:kworker.0 00000100:00100000:1.0:1788623081.016712:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774528 00000100:00100000:1.0:1788623081.016717:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774528 00000100:00100000:1.0:1788623081.016768:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788623081.016774:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875506866774528:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788623081.016810:0:14328:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:1.0:1788623081.023071:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xef842f43731d780f 00000004:00100000:1.0:1788623081.023113:0:14328:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788623081.023259:0:14328:0:(import.c:65:import_set_state_nolock()) ffff997e078f2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788623081.023365:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875506866774528:12345-0@lo:38:kworker.0 Request processed in 6588us (7079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623081.023376:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788623081.023578:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e2eec8380 x1875506866774528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788623091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788623081.023610:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788623081.023618:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788623081.023624:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788623081.023626:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e3a3e7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788623081.023632:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875506866774528:0@lo:38:kworker.0 00000001:02000400:1.0:1788623081.244575:0:14609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788623081.645794:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623082.670787:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623083.692474:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788623084.477361:0:14759:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf2afaa40 20000000:00000080:0.0:1788623084.477380:0:14759:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997e31be5000 uarg=0000000000000000 20000000:01000000:0.0:1788623084.477413:0:14759:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788623084.477421:0:14759:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788623084.477426:0:14759:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788623084.485955:0:14760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788623084.486134:0:14759:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788623084.497717:0:14759:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788623084.498068:0:14759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623084.498102:0:14759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d77d0 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623084.498111:0:14759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623084.498154:0:14759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d77d0 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623084.498168:0:14759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d77d0 expref: 11 pid: 14318 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623084.498184:0:14759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14759:1875506866774656:0@lo:104: 00000100:00100000:1.0:1788623084.498265:0:14759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623084.498323:0:14759:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2044ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623084.498672:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774656 00000100:00100000:0.0:1788623084.498680:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774656 00000100:00100000:0.0:1788623084.498738:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623084.498813:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14759:x1875506866774656:12345-0@lo:104: 00010000:00010000:0.0:1788623084.498827:0:14310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.498905:0:14310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788623084.498911:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14759:x1875506866774656:12345-0@lo:104: Request processed in 100us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623084.498918:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788623084.498939:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623084.498945:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.498952:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fac00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788623084.498956:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.498964:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788623084.498971:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623084.498977:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788623084.499008:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499014:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788623084.499032:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499050:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e372fac00/0xef842f43731d77d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d77d7 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499064:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623084.499065:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623084.499067:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623084.499117:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866774784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623084.499148:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623084.499208:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774784 00000100:00100000:0.0:1788623084.499212:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774784 00010000:00010000:0.0:1788623084.499244:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d77d0 expref: 12 pid: 14318 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623084.499265:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623084.499272:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:3280:x1875506866774784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788623084.499283:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623084.499287:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d77d0 expref: 12 pid: 14318 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499297:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d77d0 expref: 12 pid: 14318 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499314:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499323:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499341:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499354:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499361:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499368:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499373:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623084.499377:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499384:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499393:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.499403:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623084.499431:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:3280:x1875506866774784:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623084.499437:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623084.499485:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866774784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623084.499561:0:14759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e2f0db000/0xef842f43731d77d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d77d0 expref: 11 pid: 14318 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623084.499571:0:14759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14759:1875506866774656:0@lo:104: 00010000:00010000:3.0:1788623084.499585:0:14759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623084.499593:0:14759:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623084.499598:0:14759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623084.499604:0:14759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e2f0db600/0xef842f43731d7816 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623084.724241:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623085.099954:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788623075/real 1788623075] req@ffff997e2ecbd880 x1875506866771840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623085.099988:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff997e2ecbd880 x1875506866771840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623085.100004:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788623075/real 1788623075] req@ffff997e2eec8700 x1875506866771712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623085 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623085.100017:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff997e2eec8700 x1875506866771712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623085 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788623085.100036:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788623085.100179:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788623085.100185:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866771840:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788623085.100192:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788623085.100380:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866774912:0@lo:400:kworker.0 00000100:00100000:0.0:1788623085.100459:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623085.100557:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866774912 00000100:00100000:1.0:1788623085.100581:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866774912 00000100:00100000:1.0:1788623085.100647:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788623085.100658:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:3281:x1875506866774912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788623085.100953:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623085.100959:0:12328:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788623085.100962:0:12328:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788623085.100974:0:12328:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1788623085.100979:0:12328:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788623085.100986:0:12328:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff997d05d7d800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623085.101237:0:12328:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd02d80 x1875506866775040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788623085.101250:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623085.101253:0:12328:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788623085.101255:0:12328:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788623085.101259:0:12328:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1788623085.101262:0:12328:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788623085.101266:0:12328:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e116ae000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623085.101277:0:12328:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd00700 x1875506866775168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788623085.102219:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788623085.102226:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866771712:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788623085.102258:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866775040:0@lo:8:kworker.0 00000400:00000100:2.0:1788623085.102305:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875506866775040 offset 0 length 520: 4 00000100:00100000:2.0:1788623085.102330:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866775168:0@lo:8:kworker.0 00000400:00000100:2.0:1788623085.102359:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875506866775168 offset 0 length 520: 4 00000100:00100000:2.0:1788623085.102384:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866775296:0@lo:400:kworker.0 00000100:00100000:2.0:1788623085.102414:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623085.104491:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:3281:x1875506866774912:12345-0@lo:400:kworker.0 Request processed in 3822us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623085.104510:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788623085.107841:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866775296 00000100:00100000:1.0:1788623085.107859:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866775296 00000100:00100000:1.0:1788623085.107918:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788623085.107928:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623085.108023:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866775296:12345-0@lo:400:kworker.0 Request processed in 97us (5608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623085.108030:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788623085.108088:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e2fd00e00 x1875506866775296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788623085.108104:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866775296:0@lo:400:kworker.0 00000100:00100000:0.0:1788623085.108957:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866774912:0@lo:400:kworker.0 10000000:01000000:1.0:1788623085.676848:0:14323:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788623085.676857:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e36e26000 from 10 10000000:01000000:1.0:1788623085.676861:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788623085.676913:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623085.676925:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623085.676936:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623085.676964:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866775424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788623085.677057:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623085.677115:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e36e06000 going to sleep for 11 seconds 00000100:00100000:2.0:1788623085.677350:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866775424 00000100:00100000:2.0:1788623085.677358:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866775424 00000100:00100000:2.0:1788623085.677402:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788623085.677410:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+11:14323:x1875506866775424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788623085.677422:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623085.677435:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d781d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623085.677456:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d781d expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623085.677466:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d781d expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623085.677476:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fae00, rc 0) 00000100:00100000:2.0:1788623085.677523:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866775424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623085.677529:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788623085.677635:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866775424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623085.677650:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623085.677659:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623085.677714:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866775552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623085.677762:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623085.677784:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788623085.677839:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866775552 00000100:00100000:2.0:1788623085.677843:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866775552 00000100:00100000:2.0:1788623085.677872:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788623085.677878:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866775552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788623085.678146:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866775552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623085.678160:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788623085.678597:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866775552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788623085.678632:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866775680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788623085.678673:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623085.678709:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788623085.680845:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866775680 00000100:00100000:2.0:1788623085.680860:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866775680 00000100:00100000:2.0:1788623085.680917:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788623085.680928:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866775680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788623085.681181:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:14323:x1875506866775680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623085.681188:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788623085.682229:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866775680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788623085.686270:0:14813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788623085.687012:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788623085.687046:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788623085.687060:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623085.687074:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623085.741218:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623086.764828:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788623087.148479:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788623087.787874:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623088.828876:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788623089.538067:0:15009:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788623089.538073:0:15009:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788623089.538238:0:15009:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff997e3ccba000 00000020:01000004:3.0:1788623089.538256:0:15009:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788623089.538269:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788623089.538339:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff997e06554d40) 00000020:00000080:3.0:1788623089.538359:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788623089.556385:0:15009:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788623089.556770:0:15009:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788623089.557615:0:15009:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788623089.559203:0:15009:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788623089.559435:0:15009:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788623089.560025:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 559: rc = 0 00100000:10000000:2.0:1788623089.560137:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 559: rc = 0 00100000:10000000:2.0:1788623089.560235:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 559: rc = 0 00100000:10000000:2.0:1788623089.560642:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 356: rc = 0 00100000:10000000:2.0:1788623089.561077:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 356: rc = 0 00100000:10000000:2.0:1788623089.561418:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 356: rc = 0 00100000:10000000:2.0:1788623089.563042:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 356: rc = 0 00100000:10000000:2.0:1788623089.565389:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 356: rc = 0 00100000:10000000:2.0:1788623089.565695:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 356: rc = 0 00000020:00000080:2.0:1788623089.566390:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788623089.566402:0:15009:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788623089.566418:0:15009:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xef842f43731d7832 00000020:01000004:2.0:1788623089.566427:0:15009:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788623089.566449:0:15009:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.119@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788623089.566452:0:15009:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788623089.566458:0:15009:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788623089.566462:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788623089.566473:0:15009:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff997e102319c0) 00000020:00000080:2.0:1788623089.566483:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788623089.568627:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788623089.568850:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788623089.568857:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788623089.571809:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788623089.571821:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788623089.571977:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788623089.571983:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788623089.575548:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623089.577291:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788623089.577301:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788623089.583362:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788623089.583380:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788623089.607576:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788623089.608195:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788623089.608202:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788623089.609719:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788623089.609732:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788623089.610640:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788623089.610722:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788623089.617017:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788623089.617228:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788623089.617235:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788623089.624989:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788623089.625005:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788623089.661160:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788623089.661388:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788623089.661395:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788623089.662386:0:15009:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788623089.662395:0:15009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788623089.662873:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788623089.662899:0:15009:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788623089.662906:0:15009:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788623089.671051:0:15009:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788623089.671103:0:15009:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.119@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788623089.671108:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788623089.671110:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788623089.671112:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623089.671113:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623089.671125:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623089.671127:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623089.671129:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788623089.671131:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623089.671132:0:15009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788623089.671137:0:15009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788623089.671139:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788623089.671140:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788623089.671142:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623089.671143:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623089.671144:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623089.671145:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623089.671146:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788623089.671147:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623089.671148:0:15009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788623089.671176:0:15009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788623089.671197:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866775808:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788623089.671270:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.671403:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1062b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788623089.671473:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866775808 00000100:00100000:3.0:1788623089.671482:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866775808 00000100:00100000:3.0:1788623089.671584:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788623089.671596:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:15009:x1875506866775808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788623089.671638:0:14320:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788623089.671642:0:14320:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788623089.671646:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788623089.677316:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:15009:x1875506866775808:12345-0@lo:253:mount.lustre.0 Request processed in 5712us (6034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623089.677334:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788623089.677426:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866775808:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788623089.677462:0:15009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788623089.677465:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788623089.677467:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788623089.677468:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623089.677469:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623089.677470:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623089.677472:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623089.677473:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788623089.677475:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623089.677476:0:15009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788623089.677494:0:15009:0:(tgt_mount.c:101:server_register_mount()) register mount ffff997e3ccba000 from lustre-OST0000 10000000:01000000:0.0:1788623089.677521:0:15009:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788623089.677524:0:15009:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788623089.677532:0:15009:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff997d04c499c0 local copy 00010000:00010000:0.0:1788623089.677543:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623089.678369:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866775936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623089.678420:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.678734:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.681051:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866775936 00000100:00100000:2.0:1788623089.681070:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866775936 00000100:00100000:2.0:1788623089.681213:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788623089.681225:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:15009:x1875506866775936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623089.681524:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:15009:x1875506866775936:12345-0@lo:501:mount.lustre.0 Request processed in 301us (3103us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788623089.681533:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788623089.681628:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866775936:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788623089.681658:0:15009:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788623089.681885:0:15009:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788623089.681894:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.681905:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623089.681935:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff997e3ccba000 10000000:01000000:0.0:1788623089.681948:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788623089.681954:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff997d04c499c0 10000000:01000000:0.0:1788623089.681957:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788623089.681961:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff997d04c499c0 from 1 10000000:01000000:0.0:1788623089.681964:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788623089.681999:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.682007:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.682017:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623089.682040:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788623089.682077:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.682540:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788623089.683077:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776064 00000100:00100000:3.0:1788623089.683086:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776064 00000100:00100000:3.0:1788623089.683138:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788623089.683148:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+12:15009:x1875506866776064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788623089.683159:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623089.683177:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735400/0xef842f43731d7847 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7840 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.683201:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735400/0xef842f43731d7847 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7840 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.683212:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735400/0xef842f43731d7847 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7840 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.683221:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735400, rc 0) 00000100:00100000:3.0:1788623089.683267:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+13:15009:x1875506866776064:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623089.683287:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788623089.683414:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623089.683430:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7847 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.683438:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7847 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623089.683457:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788623089.683477:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7847 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.683484:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b9800/0xef842f43731d7840 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7847 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623089.683504:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788623089.683508:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788623089.683513:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788623089.683515:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788623089.683535:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.683541:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.683548:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623089.683566:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788623089.683597:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.683617:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.684948:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776192 00000100:00100000:2.0:1788623089.684958:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776192 00000100:00100000:2.0:1788623089.685006:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788623089.685016:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+13:15009:x1875506866776192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623089.685028:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623089.685041:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fa400/0xef842f43731d7855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d784e expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.685063:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fa400/0xef842f43731d7855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d784e expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.685074:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fa400/0xef842f43731d7855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d784e expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.685092:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fa400, rc 0) 00000100:00100000:0.0:1788623089.685351:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623089.685367:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7855 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.685375:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7855 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623089.685724:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776192:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.685732:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:0.0:1788623089.686734:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788623089.688603:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788623089.689090:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788623089.689157:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788623089.689193:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788623089.689257:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788623089.689296:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788623089.689331:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788623089.689419:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788623089.689428:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788623089.689521:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623089.690003:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.690055:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788623089.690144:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776320 00000100:00100000:1.0:1788623089.690160:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776320 00000100:00100000:1.0:1788623089.690216:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788623089.690225:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623089.690580:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776320:12345-0@lo:501:mount.lustre.0 Request processed in 354us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623089.690590:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788623089.690827:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623089.690868:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788623089.691035:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.691058:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788623089.691132:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776448 00000100:00100000:1.0:1788623089.691137:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776448 00000100:00100000:1.0:1788623089.691170:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788623089.691307:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788623089.691804:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776448:12345-0@lo:503:mount.lustre.0 Request processed in 499us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623089.691812:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788623089.691981:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788623089.693246:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788623089.693329:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623089.693396:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.693447:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.693772:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776576 00000100:00100000:2.0:1788623089.693779:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776576 00000100:00100000:2.0:1788623089.693836:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788623089.693846:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623089.694100:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776576:12345-0@lo:502:mount.lustre.0 Request processed in 256us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.694107:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788623089.694216:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623089.694463:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788623089.694506:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788623089.694534:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788623089.694573:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788623089.694610:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788623089.694644:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788623089.695033:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788623089.695072:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788623089.695109:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788623089.695185:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788623089.695219:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788623089.695262:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788623089.695299:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623089.695354:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.695441:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.695549:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776704 00000100:00100000:2.0:1788623089.695555:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776704 00000100:00100000:2.0:1788623089.695628:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788623089.695637:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623089.695893:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776704:12345-0@lo:502:mount.lustre.0 Request processed in 257us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.695900:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788623089.696024:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788623089.696124:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788623089.696137:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788623089.697088:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788623089.697098:0:15023:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788623089.697105:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.697107:0:15023:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788623089.697113:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788623089.697139:0:15023:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff997d04c4cd40) 00000020:00000080:1.0:1788623089.697161:0:15023:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788623089.697167:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788623089.697245:0:15023:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e3ccba000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788623089.697253:0:15023:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788623089.697265:0:15023:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xef842f43731d7863 00010000:00010000:1.0:1788623089.701595:0:15023:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788623089.702140:0:15023:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788623089.707211:0:15023:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788623089.714255:0:15023:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788623089.714269:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623089.718789:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.718801:0:15023:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788623089.718815:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788623089.718819:0:15023:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788623089.718821:0:15023:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788623089.718823:0:15023:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788623089.718824:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788623089.718831:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.718833:0:15023:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788623089.718836:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623089.718840:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.718841:0:15023:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788623089.718845:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788623089.718847:0:15023:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788623089.718849:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623089.718851:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.718861:0:15023:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788623089.718864:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623089.718867:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.718868:0:15023:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788623089.718872:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788623089.718945:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623089.718949:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623089.718950:0:15023:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788623089.718953:0:15023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788623089.719570:0:15009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788623089.719604:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788623089.719618:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7855 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.719631:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8000/0xef842f43731d784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7855 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623089.719639:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e3ccba000 from 1 10000000:01000000:0.0:1788623089.719642:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788623089.719786:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.719796:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623089.719806:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623089.719834:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788623089.719902:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.719957:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.720076:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776832 00000100:00100000:2.0:1788623089.720084:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776832 00000100:00100000:2.0:1788623089.720141:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788623089.720151:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+14:15009:x1875506866776832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623089.720164:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623089.720178:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d786a expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.720216:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d786a expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.720227:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d786a expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.720236:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fa600, rc 0) 00000100:00100000:2.0:1788623089.720283:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866776832:12345-0@lo:101:mount.lustre.0 Request processed in 134us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.720290:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788623089.720380:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788623089.720397:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.720407:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788623089.721051:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788623089.723807:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788623089.724215:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788623089.724269:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788623089.724339:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788623089.724348:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788623089.724448:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623089.724517:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623089.724554:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.725004:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866776960 00000100:00100000:2.0:1788623089.725012:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866776960 00000100:00100000:2.0:1788623089.725059:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788623089.725069:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866776960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623089.725320:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866776960:12345-0@lo:501:mount.lustre.0 Request processed in 252us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.725327:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788623089.726548:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866776960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623089.726603:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788623089.728291:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623089.728355:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.728666:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777088 00000100:00100000:2.0:1788623089.728676:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777088 00000100:00100000:2.0:1788623089.728737:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788623089.728779:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788623089.729034:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777088:12345-0@lo:503:mount.lustre.0 Request processed in 257us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.729043:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788623089.729289:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788623089.729883:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788623089.729952:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623089.730008:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.730050:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777216 00000100:00100000:0.0:1788623089.730055:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777216 00000100:00100000:0.0:1788623089.730091:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788623089.730099:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623089.730267:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777216:12345-0@lo:502:mount.lustre.0 Request processed in 167us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623089.730274:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788623089.730323:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3ccc10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623089.730338:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623089.730556:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788623089.730601:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788623089.730647:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788623089.730682:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788623089.730729:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788623089.730839:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788623089.730888:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788623089.730942:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788623089.730973:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623089.731019:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623089.731051:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777344 00000100:00100000:0.0:1788623089.731056:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777344 00000100:00100000:0.0:1788623089.731085:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788623089.731092:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623089.731248:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777344:12345-0@lo:502:mount.lustre.0 Request processed in 155us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623089.731262:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788623089.731309:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548480 going to sleep for 11 seconds 00000100:00100000:0.0:1788623089.731325:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623089.731399:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788623089.731410:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788623089.733412:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788623089.733426:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788623089.733428:0:15027:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788623089.733435:0:15027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e3ccba000 00000020:00000080:0.0:1788623089.733438:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788623089.733445:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788623089.733447:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788623089.733449:0:15027:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788623089.733451:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788623089.733453:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788623089.733454:0:15027:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788623089.733457:0:15027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e3ccba000 00000020:00000080:0.0:1788623089.733459:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788623089.733569:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788623089.733573:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788623089.733575:0:15027:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788623089.733578:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788623089.733581:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788623089.733582:0:15027:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788623089.733585:0:15027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff997e3ccba000 00000020:00000080:0.0:1788623089.733587:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788623089.736082:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788623089.736096:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788623089.736098:0:15027:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788623089.736102:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788623089.736314:0:15009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788623089.736345:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788623089.736370:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.736382:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788623089.736440:0:15009:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788623089.736443:0:15009:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff997e3ccba000 10000000:01000000:3.0:1788623089.736446:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff997e3ccba000 10000000:01000000:3.0:1788623089.736450:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788623089.736456:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e3ccba000 from 1 10000000:01000000:3.0:1788623089.736459:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788623089.736498:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.736507:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.736519:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623089.736546:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788623089.736616:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623089.736805:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623089.743094:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777472 00000100:00100000:2.0:1788623089.743111:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777472 00000100:00100000:2.0:1788623089.743192:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788623089.743201:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866777472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623089.743220:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623089.743238:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fa200/0xef842f43731d787f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7878 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.743265:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fa200/0xef842f43731d787f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7878 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.743275:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fa200/0xef842f43731d787f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7878 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.743283:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fa200, rc 0) 00000100:00100000:2.0:1788623089.743358:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777472:12345-0@lo:101:mount.lustre.0 Request processed in 159us (6742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.743364:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788623089.743475:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788623089.743495:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d787f expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.743504:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d787f expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788623089.745476:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788623089.746331:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788623089.746618:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788623089.748817:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788623089.748967:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788623089.749067:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788623089.749108:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788623089.749169:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788623089.749204:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788623089.749239:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788623089.749289:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788623089.749326:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788623089.749356:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788623089.749401:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788623089.749431:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788623089.749473:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788623089.749516:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788623089.749550:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788623089.749581:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788623089.749625:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788623089.750997:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788623089.751087:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788623089.751169:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788623089.751209:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788623089.751241:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788623089.751286:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788623089.751322:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788623089.751354:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788623089.751405:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788623089.751440:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788623089.754029:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788623089.754050:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788623089.754163:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623089.754232:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623089.756917:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623089.761031:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777600 00000100:00100000:3.0:1788623089.761047:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777600 00000100:00100000:3.0:1788623089.763385:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788623089.763413:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623089.763779:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777600:12345-0@lo:501:mount.lustre.0 Request processed in 372us (9546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623089.763787:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788623089.763897:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623089.763953:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788623089.764001:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623089.765519:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e103dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623089.768063:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777728 00000100:00100000:0.0:1788623089.768088:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777728 00000100:00100000:0.0:1788623089.768156:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788623089.768167:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788623089.768435:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777728:12345-0@lo:503:mount.lustre.0 Request processed in 270us (4432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623089.768443:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788623089.768728:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788623089.771308:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788623089.771390:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623089.771464:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623089.771514:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2078d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788623089.771583:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777856 00000100:00100000:1.0:1788623089.771591:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777856 00000100:00100000:1.0:1788623089.771632:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788623089.771641:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788623089.772012:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777856:12345-0@lo:502:mount.lustre.0 Request processed in 370us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623089.772021:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788623089.772135:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788623089.772397:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788623089.772443:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788623089.772477:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788623089.772532:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788623089.772561:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788623089.772598:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788623089.772630:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788623089.772672:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788623089.772717:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788623089.772788:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788623089.772824:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788623089.772877:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788623089.772916:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788623089.772950:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788623089.773000:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788623089.773035:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788623089.773066:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788623089.773106:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788623089.773154:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788623089.773204:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788623089.773256:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788623089.773292:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788623089.773326:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788623089.773377:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788623089.773407:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788623089.773432:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788623089.773475:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788623089.773512:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788623089.773547:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788623089.773614:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788623089.773660:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788623089.773692:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788623089.773725:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788623089.773804:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788623089.773842:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788623089.773909:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788623089.773946:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788623089.773973:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788623089.774012:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788623089.774042:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788623089.774080:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623089.774157:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623089.774188:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e2078d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788623089.774676:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866777984 00000100:00100000:1.0:1788623089.774683:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866777984 00000100:00100000:1.0:1788623089.774756:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788623089.774767:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788623089.775036:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866777984:12345-0@lo:502:mount.lustre.0 Request processed in 271us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623089.775044:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788623089.777352:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866777984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788623089.777505:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788623089.777522:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788623089.779492:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788623089.779525:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff997d04c38000) 00000020:00000080:2.0:1788623089.779550:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788623089.779637:0:15032:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e3ccba000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788623089.779642:0:15032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e3ccba000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788623089.779655:0:15032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e3ccba000 3 00010000:00080000:2.0:1788623089.779697:0:15032:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e2fd17000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.119@tcp at head 00010000:00010000:2.0:1788623089.783477:0:15032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788623089.783691:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788623089.783730:0:15032:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788623089.783763:0:15032:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xef842f43731d788d 00000100:00080000:2.0:1788623089.783774:0:15032:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788623089.783780:0:15032:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff997e2fd17000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:2.0:1788623089.783813:0:15032:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2eec8380 x1875506866778112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623089.783864:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875506866778112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788623089.784030:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623089.784096:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778112 00000100:00100000:2.0:1788623089.784102:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778112 00000100:00100000:2.0:1788623089.784138:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623089.784145:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875506866778112:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788623089.784169:0:14326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:2.0:1788623089.784197:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xef842f43731d7894 00000004:00100000:2.0:1788623089.784215:0:14326:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788623089.786380:0:14326:0:(import.c:65:import_set_state_nolock()) ffff997e2fd13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788623089.786477:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875506866778112:12345-0@lo:38:llog_process_th.0 Request processed in 2327us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.786489:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788623089.786547:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e2eec8380 x1875506866778112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788623099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623089.786558:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788623089.786566:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788623089.786573:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788623089.786578:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788623089.786580:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e2fd17000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788623089.786586:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875506866778112:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788623089.786612:0:15032:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788623089.786637:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788623089.786641:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788623089.786663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788623089.786666:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788623089.786736:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866778240:0@lo:400:kworker.0 00000100:00100000:2.0:1788623089.786791:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623089.787014:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778240 00000100:00100000:3.0:1788623089.787021:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778240 00000100:00100000:3.0:1788623089.787059:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788623089.787069:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623089.787132:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866778240:12345-0@lo:400:kworker.0 Request processed in 65us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623089.787138:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788623089.788831:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff997e2eec8380 x1875506866778240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623089.788849:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866778240:0@lo:400:kworker.0 00000040:00080000:0.0:1788623089.789426:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788623089.792462:0:15009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788623089.792505:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788623089.792528:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d787f expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.792541:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734a00/0xef842f43731d7878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d787f expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788623089.792595:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788623089.792597:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788623089.792599:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788623089.792600:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788623089.792601:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788623089.792603:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788623089.792604:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788623089.792606:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788623089.792607:0:15009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788623089.792612:0:15009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788623089.792615:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788623089.792616:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788623089.792623:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788623089.792624:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788623089.792625:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788623089.792626:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788623089.793166:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788623089.793167:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788623089.793168:0:15009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788623089.793199:0:15009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788623089.793220:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866778368:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788623089.793306:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623089.793385:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e3a22fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623089.794230:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778368 00000100:00100000:0.0:1788623089.794240:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778368 00000100:00100000:0.0:1788623089.794332:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788623089.794344:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15009:x1875506866778368:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788623089.794373:0:14320:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788623089.794388:0:14320:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788623089.821414:0:14320:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788623089.821427:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788623089.821834:0:14342:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788623089.821839:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788623089.821863:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.821893:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7801 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.821902:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.821946:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d7801 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.821962:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d7801 expref: 16 pid: 14318 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623089.821977:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1875506866778496:0@lo:104: 00000100:00100000:3.0:1788623089.822044:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623089.822085:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e078d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788623089.822127:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778496 00000100:00100000:3.0:1788623089.822135:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778496 00000100:00100000:3.0:1788623089.822196:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788623089.822205:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14342:x1875506866778496:12345-0@lo:104: 00010000:00010000:3.0:1788623089.822219:0:14310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822270:0:14310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788623089.822277:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14342:x1875506866778496:12345-0@lo:104: Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623089.822284:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788623089.822323:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1875506866778496:0@lo:104: 00010000:00010000:3.0:1788623089.822340:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822356:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623089.822362:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822368:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9400 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:3.0:1788623089.822371:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822379:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788623089.822386:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788623089.822392:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788623089.822418:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822430:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788623089.822449:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822456:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e373b9400/0xef842f43731d7801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7808 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.822473:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623089.822475:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623089.822477:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788623089.822498:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866778624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788623089.822524:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623089.823172:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778624 00000100:00100000:2.0:1788623089.823179:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778624 00010000:00010000:2.0:1788623089.823201:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d7801 expref: 17 pid: 14318 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623089.823231:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623089.823242:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:3280:x1875506866778624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788623089.823253:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623089.823258:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d7801 expref: 17 pid: 14318 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823268:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d7801 expref: 17 pid: 14318 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823281:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b8800/0xef842f43731d7808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d7801 expref: 17 pid: 14318 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823293:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823316:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788623089.823329:0:14313:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002911539s 00010000:00010000:2.0:1788623089.823333:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823340:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823347:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823353:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823359:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623089.823363:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823370:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823389:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623089.823399:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623089.823440:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3280:x1875506866778624:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623089.823447:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623089.823484:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866778624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788623089.823572:0:14342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.823581:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623089.823588:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13734000/0xef842f43731d789b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623089.834284:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:15009:x1875506866778368:12345-0@lo:253:mount.lustre.0 Request processed in 39934us (40969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623089.834301:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788623089.834393:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15009:1875506866778368:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788623089.834411:0:15009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788623089.834414:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788623089.834415:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788623089.834417:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788623089.834418:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788623089.834419:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788623089.834420:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788623089.834438:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788623089.834440:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788623089.834442:0:15009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788623089.834460:0:15009:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788623089.836100:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788623089.840228:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788623089.840401:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788623089.840563:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788623089.840984:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788623089.841154:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788623089.841380:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788623089.843369:0:15009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788623089.906725:0:15009:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788623089.906735:0:15009:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788623089.906785:0:15009:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788623089.906920:0:15009:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788623089.906935:0:15009:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788623089.906966:0:15009:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788623090.860021:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788623091.243828:0:14323:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788623091.243836:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e36e26000 from 7 10000000:01000000:3.0:1788623091.243840:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788623091.243885:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.243897:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.243908:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623091.243933:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866778752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788623091.250179:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623091.250253:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07f3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788623091.250280:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778752 00000100:00100000:3.0:1788623091.250298:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778752 00000100:00100000:3.0:1788623091.251513:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788623091.251528:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+15:14323:x1875506866778752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788623091.251545:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623091.251564:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d78a2 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.251592:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d78a2 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.251604:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d78a2 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.251614:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734000, rc 0) 00000100:00100000:3.0:1788623091.251682:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:14323:x1875506866778752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623091.251689:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788623091.252444:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866778752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788623091.252466:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.252478:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623091.252555:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866778880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788623091.252605:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623091.252637:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07f3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788623091.257188:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866778880 00000100:00100000:0.0:1788623091.257204:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866778880 00000100:00100000:0.0:1788623091.257268:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788623091.257279:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:14323:x1875506866778880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788623091.257305:0:14321:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788623091.257338:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788623091.257341:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788623091.257472:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:14323:x1875506866778880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (4865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623091.257487:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788623091.263694:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866778880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788623091.266630:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788623091.266648:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623091.266662:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623091.889172:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623092.910347:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623093.931939:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788623094.836480:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623094.836491:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788623094.836494:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623094.836498:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788623094.836546:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788623094.836578:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866779136:0@lo:400:kworker.0 00000100:00100000:3.0:1788623094.836689:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623094.837032:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779136 00000100:00100000:3.0:1788623094.837045:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779136 00000100:00100000:3.0:1788623094.837182:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788623094.837195:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866779136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623094.837274:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866779136:12345-0@lo:400:kworker.0 Request processed in 81us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623094.837284:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788623094.837350:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2fd00a80 x1875506866779136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623094.837368:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866779136:0@lo:400:kworker.0 00000100:00100000:3.0:1788623094.837419:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866779264:0@lo:400:kworker.0 00000100:00100000:3.0:1788623094.837459:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623094.837492:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779264 00000100:00100000:3.0:1788623094.837497:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779264 00000100:00100000:3.0:1788623094.837535:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788623094.837541:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866779264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623094.837578:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875506866779264:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623094.837584:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788623094.837611:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2fd00a80 x1875506866779264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623094.837621:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875506866779264:0@lo:400:kworker.0 00000100:00100000:1.0:1788623094.837763:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788623094.837776:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866779008:0@lo:400:kworker.0 00000100:00100000:1.0:1788623094.837819:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788623094.838715:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788623094.839384:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779008 00000100:00100000:3.0:1788623094.839396:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779008 00000100:00100000:3.0:1788623094.839504:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788623094.839515:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3280:x1875506866779008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623094.839621:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3280:x1875506866779008:12345-0@lo:400:kworker.0 Request processed in 107us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623094.839628:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788623094.839734:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866779008:0@lo:400:kworker.0 00010000:00010000:2.0:1788623094.959532:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623095.981306:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623097.004442:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788623097.395875:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788623098.028606:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788623098.072613:0:15375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788623099.052469:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788623099.948312:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623099.948321:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788623099.948325:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623099.948328:0:12328:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788623099.948404:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866779520:0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.948503:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623099.948579:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788623099.948585:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866779392:0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.948633:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623099.948668:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866779648:0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.948698:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623099.948762:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779520 00000100:00100000:3.0:1788623099.948775:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779520 00000100:00100000:3.0:1788623099.948843:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779648 00000100:00100000:3.0:1788623099.948847:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779648 00000100:00100000:3.0:1788623099.948889:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788623099.948901:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.949857:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866779520:12345-0@lo:400:kworker.0 Request processed in 948us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623099.949872:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788623099.949911:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788623099.950085:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2fd00380 x1875506866779520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788623099.950105:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866779520:0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.950405:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866779648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.950467:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866779648:12345-0@lo:400:kworker.0 Request processed in 72us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623099.950475:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788623099.950506:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779392 00000100:00100000:3.0:1788623099.950513:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779392 00000100:00100000:3.0:1788623099.950559:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788623099.950567:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3281:x1875506866779392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623099.950608:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3281:x1875506866779392:12345-0@lo:400:kworker.0 Request processed in 43us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623099.950796:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788623099.950847:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788623099.950875:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866779392:0@lo:400:kworker.0 00010000:00080000:1.0:1788623099.951880:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2fd02a00 x1875506866779648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788623099.951899:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866779648:0@lo:400:kworker.0 00000100:00100000:2.0:1788623100.019176:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788623085/real 1788623085] req@ffff997e2fd02d80 x1875506866775040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623100.019218:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff997e2fd02d80 x1875506866775040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623100.019229:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788623085/real 1788623085] req@ffff997e2fd00700 x1875506866775168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623100.019241:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff997e2fd00700 x1875506866775168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788623100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788623100.019265:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788623100.019293:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788623100.019298:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866775040:0@lo:8:kworker.0 00000100:00080000:2.0:1788623100.019304:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788623100.019309:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788623100.019312:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866775168:0@lo:8:kworker.0 00000100:00080000:3.0:1788623100.019450:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623100.019455:0:12328:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788623100.019459:0:12328:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788623100.019465:0:12328:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788623100.019472:0:12328:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788623100.019481:0:12328:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff997d05d7d800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623100.019524:0:12328:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd00a80 x1875506866779776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788623100.019544:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623100.019547:0:12328:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788623100.019548:0:12328:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788623100.019551:0:12328:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788623100.019554:0:12328:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788623100.019557:0:12328:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e116ae000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623100.019573:0:12328:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd03480 x1875506866779904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623100.019649:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866779776:0@lo:8:kworker.0 00000100:00100000:2.0:1788623100.019734:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623100.019819:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866779904:0@lo:8:kworker.0 00000100:00100000:2.0:1788623100.019857:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623100.020037:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779776 00000100:00100000:3.0:1788623100.020047:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779776 00000100:00100000:3.0:1788623100.020082:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866779904 00000100:00100000:3.0:1788623100.020086:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866779904 00000100:00100000:3.0:1788623100.020102:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788623100.020111:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875506866779776:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788623100.020316:0:15011:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1788623100.020374:0:15011:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d78b0 00002000:00100000:3.0:1788623100.020392:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff997e3a3e1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788623100.020397:0:15011:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788623100.020410:0:15011:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788623100.021112:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788623100.021150:0:15011:0:(import.c:65:import_set_state_nolock()) ffff997e3a3e3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788623100.021269:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875506866779776:12345-0@lo:8:kworker.0 Request processed in 1155us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623100.021281:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788623100.021410:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788623100.021418:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875506866779904:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788623100.021437:0:15011:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788623100.021468:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875506866779904:12345-0@lo:8:kworker.0 Request processed in 50us (1611us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788623100.021474:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788623100.021801:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2fd00a80 x1875506866779776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788623120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623100.021817:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788623100.021828:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788623100.021839:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788623100.021846:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788623100.021849:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997d05d7d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788623100.021868:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788623100.021875:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866779776:0@lo:8:kworker.0 00000100:00080000:2.0:1788623100.021891:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788623100.021895:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788623100.021899:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866779904:0@lo:8:kworker.0 00000004:00080000:1.0:1788623100.022055:0:14349:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788623100.022087:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14349:1875506866780160:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788623100.022094:0:14348:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788623100.022150:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623100.022185:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e372dec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788623100.022202:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788623100.022212:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866780032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788623100.022242:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623100.022295:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780032 00000100:00100000:1.0:1788623100.022302:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780032 00000100:00100000:1.0:1788623100.022371:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788623100.022381:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866780032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788623100.022423:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623100.022472:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866780032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623100.022480:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788623100.022501:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788623100.022522:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780160 00000100:00100000:1.0:1788623100.022526:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780160 00000100:00100000:1.0:1788623100.022560:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788623100.022569:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14349:x1875506866780160:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788623100.022699:0:14348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423977955495ns, next at 0ns, rc = 0 00010000:00080000:0.0:1788623100.026830:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e3a317b80 x1875506866780032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788623116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788623100.027073:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866780032:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788623100.029458:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788623100.029475:0:15013:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788623100.029489:0:15013:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788623100.041449:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788623100.041464:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041481:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1788623100.041486:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623100.041493:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041514:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041527:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041536:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041564:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.041581:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.041587:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041594:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.041599:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041622:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041638:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041646:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d78b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.041665:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.041667:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.041669:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.043528:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.043540:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.043555:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1788623100.043560:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.043567:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.043583:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.043593:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.043601:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.043644:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788623100.043671:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623100.043687:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.043700:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623100.043706:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.043719:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.043769:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.043793:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d78be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.043828:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.043831:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.043838:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.044227:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.044235:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044245:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1788623100.044248:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.044252:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044262:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044271:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044279:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044302:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788623100.044814:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.044821:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044831:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1788623100.044843:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.044849:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044859:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044867:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044874:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.044896:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788623100.045017:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788623100.045028:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045039:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623100.045045:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045056:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045078:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045088:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d78c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045113:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623100.045117:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045131:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9e00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623100.045136:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045146:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045157:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045163:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d78cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045178:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.045180:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.045182:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.045375:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.045384:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.045394:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1788623100.045399:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.045404:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.045414:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.045423:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.045440:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.045463:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788623100.045480:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623100.045488:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045497:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623100.045501:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045510:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045534:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045542:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d78d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.045563:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.045566:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.045568:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.051689:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.060257:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.060271:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060290:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.060295:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.060302:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060321:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060333:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060341:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060366:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788623100.060867:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.060873:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060889:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.060892:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.060896:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060906:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060926:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060935:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.060953:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788623100.061363:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.061369:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061378:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.061382:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.061386:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061396:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061416:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061423:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061431:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788623100.061861:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.061868:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061876:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.061880:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.061884:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061895:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061902:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061910:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.061946:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788623100.062367:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.062372:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.062380:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.062383:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.062387:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.062396:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.062404:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.062410:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.062418:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788623100.069968:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788623100.069981:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.069996:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.070002:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070031:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070058:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070067:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d78da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070094:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788623100.070099:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070106:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.070110:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070118:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070129:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070137:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d78e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070167:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788623100.070171:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070178:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.070182:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070190:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070201:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070209:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d78e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070222:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788623100.070225:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070231:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8e00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.070235:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070254:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070265:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070272:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d78ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.070285:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788623100.070316:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.070325:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.070340:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.070350:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.070357:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.070371:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.070381:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.070466:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.070480:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.072524:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623100.073627:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.073661:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.073670:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.073683:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.073704:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.073712:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d78f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.074641:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.074645:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.074649:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.074973:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.074984:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.075002:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.075007:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.075016:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.075032:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.075045:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.075063:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.075089:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.075171:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.075179:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.075191:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.075198:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.075209:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.075229:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.075245:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098c20479/0xef842f43731d7904 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.075269:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.075271:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.075273:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.077701:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.078095:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.078108:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.078124:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.078129:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.078136:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.078223:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.078237:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.078246:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.078267:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.078386:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.078400:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.078415:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.078422:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.078434:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.078458:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.078467:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca47818a/0xef842f43731d790b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.078491:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.078494:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.078508:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.078572:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.078575:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.078576:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.078604:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.078617:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.078622:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.078645:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.078664:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.078671:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d78fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.078700:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.078703:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.078705:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.082314:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.082329:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.082357:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.082364:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.082372:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.082468:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.082482:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.082491:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.082526:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623100.082976:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623100.082986:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.083011:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9e00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.083016:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.083028:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.083050:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.083059:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eaf1e0e/0xef842f43731d7912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.083084:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.083087:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.083089:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.083536:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.083543:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.083553:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.083672:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.083680:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.083693:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.083717:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.083724:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.083772:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.084017:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.084032:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.084045:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.084051:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.084063:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.084157:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.084169:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ab964e6/0xef842f43731d7919 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.084200:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.084202:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.084205:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.085165:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.085175:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085188:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.085191:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.085197:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085209:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085455:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085465:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085505:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623100.085524:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623100.085530:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085538:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623100.085543:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085553:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085958:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085966:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.085988:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.085990:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.085991:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.089081:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.089095:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.089114:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.089130:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.089137:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.089152:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.089163:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.089171:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.089199:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623100.089230:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623100.089245:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.089258:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623100.089264:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.089276:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.089314:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.089324:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052b6e0e6/0xef842f43731d7927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623100.089352:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.089355:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623100.089356:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.091936:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.091949:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.091966:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.091971:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.091977:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.091992:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092002:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092018:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092050:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623100.092070:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623100.092076:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092085:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623100.092090:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092100:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092118:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092126:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d792e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092148:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.092150:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.092152:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.092877:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.092892:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092902:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.092906:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.092910:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092933:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092942:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092949:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092963:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623100.092970:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623100.092975:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092981:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8e00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623100.092984:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.092992:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.093011:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.093018:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044f7a7b6/0xef842f43731d7935 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.093045:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.093047:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.093048:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.094201:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.094211:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.094296:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.094301:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.094306:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.094318:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.094328:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.094336:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.094376:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.094536:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.094551:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.094582:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.094589:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.094602:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.094636:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.094646:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3b20e9/0xef842f43731d793c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.094675:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.094677:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.094679:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.095581:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.095591:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095604:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.095608:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.095613:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095626:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095638:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095646:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095687:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623100.095706:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623100.095713:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095721:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623100.095735:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095781:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095811:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095820:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d7943 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.095844:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.095846:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.095848:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.096518:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.096527:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.096537:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.096540:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.096545:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.096556:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.096564:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.096579:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.096605:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.096689:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.096702:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.096716:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.096721:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.096733:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.096800:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.096809:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2d2ad77/0xef842f43731d794a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.096841:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.096844:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.096848:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.097117:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.097124:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.097134:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.097137:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.097141:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.097152:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.097161:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.097169:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.097189:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788623100.097198:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623100.097207:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.097217:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623100.097221:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.097231:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.097246:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.097254:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000beab025/0xef842f43731d7951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.097293:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.097296:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623100.097301:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.098176:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.098187:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098206:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.098211:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.098217:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098232:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098242:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098250:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098271:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623100.098293:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623100.098299:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098307:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623100.098312:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098321:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098350:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788623100.098356:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788623100.098359:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca3d096/0xef842f43731d7958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.098464:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.098467:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.098471:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788623100.102353:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788623100.102366:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.104608:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788623100.104624:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623100.104636:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.104663:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.105563:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.105578:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.105779:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788623100.106213:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623100.106225:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.106240:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b8200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623100.106246:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.106259:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.106287:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.106296:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7e29cfb/0xef842f43731d795f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.106338:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.106340:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.106342:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788623100.109412:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788623100.109427:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.109447:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788623100.109452:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623100.109460:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.109475:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.109486:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.109494:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.109520:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788623100.110257:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623100.110267:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.110280:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623100.110286:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.110298:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.110321:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.110330:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b6531f3/0xef842f43731d7966 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623100.110354:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.110356:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623100.110358:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788623100.112250:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788623100.112265:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.112297:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788623100.112303:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623100.112310:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.112326:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.112337:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.112346:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623100.112473:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788623100.112780:0:15013:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788623100.112929:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14349:x1875506866780160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90347us (90765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623100.112941:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623100.113116:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14349:1875506866780160:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788623100.113136:0:14349:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788623100.113206:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14349:1875506866780288:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788623100.113252:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623100.113309:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788623100.115072:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780288 00000100:00100000:1.0:1788623100.115098:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780288 00000100:00100000:1.0:1788623100.115182:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788623100.115195:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14349:x1875506866780288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788623100.115261:0:15011:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788623100.121231:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623100.121252:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.121271:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dbe00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623100.121278:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.121291:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.121318:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.121328:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016876756/0xef842f43731d796d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623100.121356:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.121359:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623100.121361:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623100.136554:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14349:x1875506866780288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21348us (23288us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788623100.136593:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788623100.136844:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14349:1875506866780288:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788623100.136869:0:14349:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:2.0:1788623100.579118:0:6680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788623100.579143:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788623101.101007:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623102.124053:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623103.148538:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623104.177957:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788623105.068305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788623105.068312:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788623105.068316:0:38:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788623105.068325:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788623105.068331:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788623105.068338:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e116ae000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:2.0:1788623105.068359:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2eeca680 x1875506866780672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623105.068436:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866780544:0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.068514:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623105.068593:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788623105.068600:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866780416:0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.068629:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623105.068663:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866780672:0@lo:8:kworker.0 00000100:00100000:2.0:1788623105.068686:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623105.068712:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866780800:0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.068738:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623105.068802:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788623105.068829:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866780928:0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.068865:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623105.068908:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780416 00000100:00100000:2.0:1788623105.068915:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780416 00000100:00100000:2.0:1788623105.068957:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788623105.068967:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3281:x1875506866780416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623105.069010:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780800 00000100:00100000:2.0:1788623105.069014:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3281:x1875506866780416:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623105.069016:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780800 00000100:00100000:2.0:1788623105.069025:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788623105.069054:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780928 00000100:00100000:0.0:1788623105.069058:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780928 00000100:00100000:2.0:1788623105.069087:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780544 00000100:00100000:2.0:1788623105.069092:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780544 00000100:00100000:0.0:1788623105.069093:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788623105.069104:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866780800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.069122:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866780672 00000100:00100000:2.0:1788623105.069126:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866780672 00000100:00100000:2.0:1788623105.069140:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788623105.069146:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866780544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623105.069177:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866780800:12345-0@lo:400:kworker.0 Request processed in 74us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623105.069186:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788623105.069191:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866780544:12345-0@lo:400:kworker.0 Request processed in 43us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623105.069198:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788623105.069206:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788623105.069218:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788623105.069219:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866780928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.069226:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875506866780672:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788623105.069245:0:15012:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788623105.069254:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866780928:12345-0@lo:400:kworker.0 Request processed in 40us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623105.069264:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788623105.069288:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788623105.069292:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623105.070384:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866781056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788623105.070438:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623105.070495:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781056 00000100:00100000:0.0:1788623105.070502:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781056 00000100:00100000:0.0:1788623105.070540:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623105.070553:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866781056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788623105.070583:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788623105.070624:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866781056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623105.070630:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623105.070661:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788623105.070682:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866781056:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788623105.081200:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2eec9c00 x1875506866780928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788623105.081210:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866780416:0@lo:400:kworker.0 00000100:00100000:3.0:1788623105.081220:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866780928:0@lo:400:kworker.0 00000100:00100000:1.0:1788623105.081232:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866780544:0@lo:400:kworker.0 00010000:00080000:3.0:1788623105.081242:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff997e2eecb480 x1875506866780800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623105.081252:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866780800:0@lo:400:kworker.0 00000100:00100000:2.0:1788623105.118203:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875506866780672:12345-0@lo:8:kworker.0 Request processed in 48971us (49509us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788623105.118219:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788623105.121618:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788623105.121631:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788623105.121636:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866780672:0@lo:8:kworker.0 00010000:00010000:2.0:1788623105.199586:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788623106.007065:0:15728:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788623106.007070:0:15728:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788623106.007244:0:15728:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff997e2fd16800 00000020:01000004:2.0:1788623106.007270:0:15728:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788623106.007287:0:15728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788623106.007305:0:15728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff997d04c3cd40) 00000020:00000080:2.0:1788623106.007328:0:15728:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788623106.050379:0:15728:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788623106.050731:0:15728:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788623106.051537:0:15728:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788623106.051821:0:15728:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788623106.052048:0:15728:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788623106.058716:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 461: rc = 0 00100000:10000000:2.0:1788623106.059189:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 461: rc = 0 00100000:10000000:2.0:1788623106.059291:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 461: rc = 0 00100000:10000000:2.0:1788623106.063484:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 558: rc = 0 00100000:10000000:2.0:1788623106.064277:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 558: rc = 0 00100000:10000000:2.0:1788623106.066129:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 558: rc = 0 00100000:10000000:2.0:1788623106.066405:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 558: rc = 0 00100000:10000000:2.0:1788623106.067379:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 558: rc = 0 00100000:10000000:2.0:1788623106.067735:0:15728:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 558: rc = 0 00000020:00000080:2.0:1788623106.069027:0:15728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788623106.069045:0:15728:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788623106.069061:0:15728:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xef842f43731d797b 00000020:01000004:2.0:1788623106.069072:0:15728:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788623106.069104:0:15728:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.119@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788623106.069109:0:15728:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788623106.069117:0:15728:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788623106.069152:0:15728:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788623106.069157:0:15728:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788623106.079368:0:15728:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788623106.079431:0:15728:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.119@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788623106.079438:0:15728:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788623106.079440:0:15728:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788623106.079441:0:15728:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788623106.079443:0:15728:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788623106.079444:0:15728:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788623106.079445:0:15728:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788623106.079447:0:15728:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788623106.079449:0:15728:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788623106.079451:0:15728:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788623106.079456:0:15728:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788623106.079459:0:15728:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788623106.079460:0:15728:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788623106.079461:0:15728:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788623106.079462:0:15728:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788623106.079464:0:15728:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788623106.079465:0:15728:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788623106.079466:0:15728:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788623106.079467:0:15728:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788623106.079469:0:15728:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788623106.079509:0:15728:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788623106.079540:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788623106.079642:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.079706:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e08946cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.080003:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781184 00000100:00100000:0.0:1788623106.080014:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781184 00000100:00100000:0.0:1788623106.080084:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788623106.080095:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15728:x1875506866781184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788623106.080138:0:14320:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788623106.080141:0:14320:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788623106.080146:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788623106.097906:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15728:x1875506866781184:12345-0@lo:253:mount.lustre.0 Request processed in 17802us (18253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.097923:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788623106.098026:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788623106.098178:0:15728:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788623106.098182:0:15728:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788623106.098184:0:15728:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788623106.098185:0:15728:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788623106.098187:0:15728:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788623106.098188:0:15728:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788623106.098189:0:15728:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788623106.098191:0:15728:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788623106.098193:0:15728:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788623106.098194:0:15728:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788623106.098214:0:15728:0:(tgt_mount.c:101:server_register_mount()) register mount ffff997e2fd16800 from lustre-OST0001 10000000:01000000:2.0:1788623106.098242:0:15728:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788623106.098257:0:15728:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788623106.098265:0:15728:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff997d04c499c0 local copy 00010000:00010000:2.0:1788623106.098276:0:15728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623106.098598:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788623106.098641:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.098679:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1050c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788623106.098730:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781312 00000100:00100000:1.0:1788623106.098782:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781312 00000100:00100000:1.0:1788623106.098864:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788623106.098877:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15728:x1875506866781312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623106.099300:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15728:x1875506866781312:12345-0@lo:501:mount.lustre.0 Request processed in 425us (657us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788623106.099309:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788623106.099547:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781312:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788623106.099642:0:15728:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788623106.099897:0:15728:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788623106.099909:0:15728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.099921:0:15728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8600/0xef842f43731d7728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d772f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623106.100097:0:15728:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff997e2fd16800 10000000:01000000:2.0:1788623106.100106:0:15728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788623106.100113:0:15728:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788623106.100116:0:15728:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788623106.100121:0:15728:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788623106.100125:0:15728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788623106.100165:0:15728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.100175:0:15728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.100201:0:15728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623106.100224:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788623106.100272:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.100366:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1050c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.102891:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781440 00000100:00100000:0.0:1788623106.102910:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781440 00000100:00100000:2.0:1788623106.104970:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788623106.104987:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:15728:x1875506866781440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788623106.105012:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623106.105038:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fbe00/0xef842f43731d7989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7982 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.105077:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fbe00/0xef842f43731d7989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7982 expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.105091:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fbe00/0xef842f43731d7989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7982 expref: 17 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.105102:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fbe00, rc 0) 00000100:00100000:2.0:1788623106.105212:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781440:12345-0@lo:101:mount.lustre.0 Request processed in 229us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623106.105219:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788623106.105425:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623106.105451:0:15728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7989 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.105463:0:15728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7989 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788623106.109323:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788623106.111610:0:15728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788623106.114026:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788623106.114128:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788623106.114176:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788623106.114237:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788623106.114276:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788623106.114310:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788623106.114392:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788623106.114402:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788623106.114541:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623106.114608:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.114655:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e081ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788623106.115112:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781568 00000100:00100000:3.0:1788623106.115128:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781568 00000100:00100000:3.0:1788623106.115213:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788623106.115226:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623106.116368:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781568:12345-0@lo:501:mount.lustre.0 Request processed in 1142us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623106.116391:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788623106.117791:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623106.117887:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788623106.118457:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.118516:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e081ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788623106.118707:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781696 00000100:00100000:3.0:1788623106.118717:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781696 00000100:00100000:3.0:1788623106.118884:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788623106.118896:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788623106.119367:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781696:12345-0@lo:503:mount.lustre.0 Request processed in 472us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623106.119376:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788623106.119491:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781696:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788623106.120201:0:15728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788623106.120306:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623106.120364:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.125026:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07096000 going to sleep for 11 seconds 00000100:00100000:2.0:1788623106.125181:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781824 00000100:00100000:2.0:1788623106.125194:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781824 00000100:00100000:2.0:1788623106.125262:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788623106.125272:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623106.126910:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781824:12345-0@lo:502:mount.lustre.0 Request processed in 1630us (6536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623106.126938:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788623106.127176:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623106.128422:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788623106.128502:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788623106.128545:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788623106.128939:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788623106.129142:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788623106.129184:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788623106.129232:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788623106.129272:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788623106.129349:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788623106.129420:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623106.129527:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.129736:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e081ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788623106.130029:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866781952 00000100:00100000:3.0:1788623106.130039:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866781952 00000100:00100000:3.0:1788623106.130281:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788623106.130292:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788623106.130593:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866781952:12345-0@lo:502:mount.lustre.0 Request processed in 301us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623106.130602:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788623106.130709:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866781952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623106.131350:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788623106.131368:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788623106.135866:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788623106.135883:0:15730:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788623106.135892:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623106.135895:0:15730:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788623106.135904:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788623106.135927:0:15730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff997d04c3b380) 00000020:00000080:2.0:1788623106.136029:0:15730:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788623106.136038:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788623106.136128:0:15730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e2fd16800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788623106.136138:0:15730:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788623106.136148:0:15730:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xef842f43731d7997 00010000:00010000:2.0:1788623106.145327:0:15730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788623106.146102:0:15730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788623106.148646:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788623106.150182:0:15730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788623106.150198:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788623106.150207:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623106.150209:0:15730:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788623106.150216:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788623106.150221:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623106.150222:0:15730:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788623106.150225:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788623106.150227:0:15730:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788623106.150230:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788623106.150232:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623106.150233:0:15730:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788623106.150235:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788623106.150238:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623106.150239:0:15730:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788623106.150242:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788623106.150316:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788623106.150326:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788623106.150328:0:15730:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788623106.150332:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788623106.150586:0:15728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788623106.150628:0:15728:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788623106.150658:0:15728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7989 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.150672:0:15728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e372fa800/0xef842f43731d7982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7989 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623106.150681:0:15728:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e2fd16800 from 1 10000000:01000000:0.0:1788623106.150684:0:15728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788623106.150771:0:15728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.150779:0:15728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.150792:0:15728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623106.150836:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788623106.150925:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.150978:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782080 00000100:00100000:0.0:1788623106.150987:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782080 00000100:00100000:0.0:1788623106.151043:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788623106.151052:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:15728:x1875506866782080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623106.151069:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623106.151083:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d799e expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.151122:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d799e expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.151134:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d799e expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.151144:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9200, rc 0) 00000100:00100000:0.0:1788623106.151184:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782080:12345-0@lo:101:mount.lustre.0 Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.151190:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788623106.151236:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07096000 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.151261:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623106.151279:0:15728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.151289:0:15728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788623106.151885:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788623106.152221:0:15728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788623106.152481:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788623106.152532:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788623106.152602:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788623106.152611:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788623106.152691:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623106.152788:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.152829:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07096000 going to sleep for 11 seconds 00000100:00100000:3.0:1788623106.155529:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782208 00000100:00100000:3.0:1788623106.155549:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782208 00000100:00100000:3.0:1788623106.155624:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788623106.155636:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623106.159271:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782208:12345-0@lo:501:mount.lustre.0 Request processed in 3624us (6468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623106.159289:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788623106.162601:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623106.162690:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788623106.163221:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.163314:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07096000 going to sleep for 11 seconds 00000100:00100000:1.0:1788623106.163357:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782336 00000100:00100000:1.0:1788623106.163366:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782336 00000100:00100000:1.0:1788623106.163458:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788623106.163470:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788623106.163869:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782336:12345-0@lo:503:mount.lustre.0 Request processed in 401us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623106.163878:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788623106.163984:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782336:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788623106.164829:0:15728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788623106.164923:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623106.164993:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.165432:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1036ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.165496:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782464 00000100:00100000:0.0:1788623106.165504:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782464 00000100:00100000:0.0:1788623106.165549:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788623106.165560:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623106.166019:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782464:12345-0@lo:502:mount.lustre.0 Request processed in 459us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.166028:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788623106.166174:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788623106.166445:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788623106.166501:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788623106.166553:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788623106.166620:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788623106.166664:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788623106.166707:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788623106.166811:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788623106.166848:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788623106.166885:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623106.166957:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.166993:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1036ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.169004:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782592 00000100:00100000:0.0:1788623106.169025:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782592 00000100:00100000:0.0:1788623106.169092:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788623106.169102:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623106.169444:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782592:12345-0@lo:502:mount.lustre.0 Request processed in 342us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.169454:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788623106.169650:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788623106.169882:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788623106.169902:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788623106.171436:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623106.171456:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623106.171460:0:15734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788623106.171468:0:15734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e2fd16800 00000020:00000080:1.0:1788623106.171471:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788623106.171479:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623106.171482:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623106.171483:0:15734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788623106.171500:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623106.171503:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623106.171505:0:15734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788623106.171508:0:15734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff997e2fd16800 00000020:00000080:1.0:1788623106.171510:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788623106.171617:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623106.171621:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623106.171622:0:15734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788623106.171624:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788623106.171627:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623106.171628:0:15734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788623106.171632:0:15734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff997e2fd16800 00000020:00000080:1.0:1788623106.171634:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788623106.184426:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788623106.184445:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788623106.184448:0:15734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788623106.184455:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788623106.186576:0:15728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788623106.186631:0:15728:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788623106.186663:0:15728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.186695:0:15728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788623106.186780:0:15728:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788623106.186783:0:15728:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff997e2fd16800 10000000:01000000:2.0:1788623106.186787:0:15728:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff997e2fd16800 10000000:01000000:2.0:1788623106.186792:0:15728:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788623106.186809:0:15728:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff997e2fd16800 from 1 10000000:01000000:2.0:1788623106.186812:0:15728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788623106.186862:0:15728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.186871:0:15728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623106.186884:0:15728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623106.186916:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788623106.187098:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.187164:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1036ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.187499:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782720 00000100:00100000:0.0:1788623106.187509:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782720 00000100:00100000:0.0:1788623106.187572:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788623106.187583:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866782720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623106.187599:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623106.187617:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b8800/0xef842f43731d79b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d79ac expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.187647:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b8800/0xef842f43731d79b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d79ac expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.187669:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b8800/0xef842f43731d79b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d79ac expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.187680:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8800, rc 0) 00000100:00100000:0.0:1788623106.187762:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866782720:12345-0@lo:101:mount.lustre.0 Request processed in 159us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.187770:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788623106.187839:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788623106.187857:0:15728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79b3 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.187867:0:15728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d79b3 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788623106.191953:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788623106.199833:0:15728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788623106.200830:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788623106.200890:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788623106.200923:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788623106.200968:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788623106.201008:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788623106.201131:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788623106.201170:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788623106.201222:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788623106.201913:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788623106.201954:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788623106.201990:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788623106.203948:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788623106.204339:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788623106.204380:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788623106.204438:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788623106.204478:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788623106.204519:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788623106.204594:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788623106.204636:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788623106.204674:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788623106.204730:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788623106.206512:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788623106.206566:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788623106.206675:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788623106.206715:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788623106.206766:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788623106.206835:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788623106.206881:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788623106.206918:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788623106.206966:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788623106.207005:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788623106.207058:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788623106.207094:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788623106.207167:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788623106.207209:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788623106.207260:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788623106.207297:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788623106.207415:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788623106.207424:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788623106.207592:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788623106.207693:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.214148:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788623106.215001:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782848 00000100:00100000:3.0:1788623106.215094:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782848 00000100:00100000:3.0:1788623106.215176:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788623106.215189:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866782848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788623106.216400:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866782848:12345-0@lo:501:mount.lustre.0 Request processed in 1206us (8700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623106.216414:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788623106.217263:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788623106.217340:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788623106.217435:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623106.217489:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06548480 going to sleep for 11 seconds 00000100:00100000:2.0:1788623106.220089:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866782976 00000100:00100000:2.0:1788623106.220109:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866782976 00000100:00100000:2.0:1788623106.220212:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788623106.220225:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866782976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788623106.220791:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866782976:12345-0@lo:503:mount.lustre.0 Request processed in 567us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623106.220810:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788623106.221320:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866782976:0@lo:503:mount.lustre.0 00010000:00010000:0.0:1788623106.222096:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788623106.223788:0:15728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788623106.223947:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866783104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623106.224130:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.224187:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788623106.224908:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783104 00000100:00100000:1.0:1788623106.224922:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783104 00000100:00100000:1.0:1788623106.224985:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788623106.224995:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866783104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788623106.225588:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866783104:12345-0@lo:502:mount.lustre.0 Request processed in 592us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623106.225601:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788623106.226169:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866783104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623106.226594:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788623106.226668:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788623106.226707:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788623106.226821:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788623106.226865:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788623106.237282:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788623106.237344:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788623106.237382:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788623106.237438:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788623106.237482:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788623106.237527:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788623106.237602:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788623106.237651:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788623106.237690:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788623106.246111:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788623106.246284:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788623106.246324:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788623106.246451:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788623106.246494:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788623106.246528:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788623106.246580:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788623106.246663:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788623106.246697:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788623106.246768:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788623106.246821:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788623106.246851:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788623106.248058:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788623106.248123:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788623106.248150:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788623106.248191:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788623106.248219:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788623106.248245:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788623106.248271:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788623106.248308:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788623106.248336:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788623106.248375:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788623106.248404:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788623106.248459:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788623106.248510:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788623106.248537:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788623106.248601:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866783232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788623106.248704:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.248790:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1036ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.249450:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783232 00000100:00100000:0.0:1788623106.249461:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783232 00000100:00100000:0.0:1788623106.249544:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788623106.249555:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866783232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788623106.249944:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866783232:12345-0@lo:502:mount.lustre.0 Request processed in 389us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.249953:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788623106.250156:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866783232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788623106.250282:0:15728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788623106.250299:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788623106.255580:0:15739:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788623106.256262:0:15739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff997e06553380) 00000020:00000080:3.0:1788623106.256293:0:15739:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788623106.256481:0:15739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff997e2fd16800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788623106.256486:0:15739:0:(tgt_mount.c:187:server_put_mount()) put mount ffff997e2fd16800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788623106.256489:0:15739:0:(obd_mount.c:710:lustre_put_lsi()) put ffff997e2fd16800 3 00010000:00080000:3.0:1788623106.256528:0:15739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff997e1021d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.119@tcp at head 00010000:00010000:3.0:1788623106.261281:0:15739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788623106.261830:0:15739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788623106.261882:0:15739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788623106.261911:0:15739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xef842f43731d79c1 00000100:00080000:3.0:1788623106.261926:0:15739:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788623106.261933:0:15739:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff997e1021d800 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623106.261995:0:15739:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd01500 x1875506866783360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788623106.262026:0:15739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788623106.262081:0:12328:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788623106.262086:0:12328:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788623106.262088:0:12328:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788623106.262093:0:12328:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1788623106.262096:0:12328:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788623106.262100:0:12328:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e116ae000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:3.0:1788623106.262114:0:12328:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2fd03100 x1875506866783616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788623106.262192:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866783744:0@lo:400:kworker.0 00000100:00100000:3.0:1788623106.262281:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623106.262326:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788623106.262332:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866783872:0@lo:400:kworker.0 00000100:00100000:3.0:1788623106.262367:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623106.263485:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783744 00000100:00100000:3.0:1788623106.263500:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783744 00000100:00100000:3.0:1788623106.263560:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783872 00000100:00100000:3.0:1788623106.263563:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783872 00000100:00100000:3.0:1788623106.263585:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788623106.264837:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788623106.264876:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866783488:0@lo:400:kworker.0 00000100:00100000:2.0:1788623106.264963:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623106.266217:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866783744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623106.266316:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866783744:12345-0@lo:400:kworker.0 Request processed in 116us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623106.268260:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866783360:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788623106.268353:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623106.268401:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866783616:0@lo:8:kworker.0 00000100:00100000:2.0:1788623106.268426:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.269678:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788623106.269692:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788623106.269718:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783488 00000100:00100000:0.0:1788623106.269730:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783488 00000100:00100000:0.0:1788623106.269828:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783616 00000100:00100000:0.0:1788623106.269833:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783616 00000100:00100000:0.0:1788623106.269850:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623106.269860:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866783488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623106.269961:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788623106.269961:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866783488:12345-0@lo:400:kworker.0 Request processed in 102us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623106.269974:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623106.269976:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623106.269996:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788623106.270000:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875506866783616:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788623106.270058:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875506866783616:12345-0@lo:8:kworker.0 Request processed in 55us (1630us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788623106.270065:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788623106.270122:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866783488:0@lo:400:kworker.0 00000100:00100000:0.0:1788623106.270164:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788623106.270170:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866783872:12345-0@lo:400:kworker.0 Request processed in 47us (7649us total) trans 0 rc 0/0 00000100:00080000:0.0:1788623106.270172:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788623106.270177:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788623106.270178:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788623106.270180:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866783616:0@lo:8:kworker.0 00000100:00100000:1.0:1788623106.270194:0:14328:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788623106.270202:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866783360 00000100:00100000:1.0:1788623106.270206:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866783360 00000100:00100000:1.0:1788623106.270219:0:14328:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788623106.270228:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788623106.270232:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875506866783360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788623106.270252:0:14328:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1788623106.270303:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xef842f43731d79c8 00000004:00100000:1.0:1788623106.270325:0:14328:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788623106.270369:0:14328:0:(import.c:65:import_set_state_nolock()) ffff997e08359800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788623106.270464:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875506866783360:12345-0@lo:38:llog_process_th.0 Request processed in 229us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623106.270472:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788623106.272108:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788623106.272342:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2fd01880 x1875506866783872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623106.272360:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866783872:0@lo:400:kworker.0 00010000:00080000:3.0:1788623106.272376:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2fd02680 x1875506866783744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623106.272385:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866783744:0@lo:400:kworker.0 00000040:00080000:3.0:1788623106.273583:0:15739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788623106.274426:0:15728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788623106.274465:0:15728:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788623106.274485:0:15728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79b3 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.274499:0:15728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e372fb400/0xef842f43731d79ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79b3 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788623106.275187:0:15728:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788623106.275191:0:15728:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788623106.275192:0:15728:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623106.275193:0:15728:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623106.275194:0:15728:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623106.275197:0:15728:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623106.275198:0:15728:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788623106.275201:0:15728:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623106.275202:0:15728:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788623106.275208:0:15728:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788623106.275218:0:15728:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788623106.275220:0:15728:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788623106.275220:0:15728:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623106.275221:0:15728:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623106.275222:0:15728:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623106.275223:0:15728:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623106.275224:0:15728:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788623106.275225:0:15728:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623106.275226:0:15728:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788623106.275262:0:15728:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788623106.275287:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866784000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788623106.275384:0:15728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623106.275439:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0735a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.276820:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784000 00000100:00100000:0.0:1788623106.276836:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784000 00000100:00100000:0.0:1788623106.276901:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788623106.276914:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:15728:x1875506866784000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788623106.276986:0:14320:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788623106.277006:0:14320:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788623106.278184:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2fd01500 x1875506866783360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788623116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623106.278201:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788623106.278212:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788623106.278223:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788623106.278230:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788623106.278234:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e1021d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788623106.278243:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875506866783360:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788623106.347066:0:14320:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788623106.347093:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788623106.347157:0:14342:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788623106.347163:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788623106.347193:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623106.347239:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d78a2 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623106.347255:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623106.347306:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d78a2 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623106.347323:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d78a2 expref: 19 pid: 14318 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623106.347341:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd02680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1875506866784128:0@lo:104: 00000100:00100000:3.0:1788623106.347431:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623106.347505:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788623106.347779:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784128 00000100:00100000:0.0:1788623106.347790:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784128 00000100:00100000:0.0:1788623106.347855:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788623106.347865:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14342:x1875506866784128:12345-0@lo:104: 00010000:00010000:0.0:1788623106.347883:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623106.347949:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788623106.347956:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:14342:x1875506866784128:12345-0@lo:104: Request processed in 92us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623106.347971:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788623106.348041:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd02680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1875506866784128:0@lo:104: 00010000:00010000:0.0:1788623106.348065:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348134:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623106.348143:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348151:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734600 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:1.0:1788623106.348156:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348165:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788623106.348184:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623106.348190:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788623106.348231:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348238:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788623106.348262:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348269:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e13734600/0xef842f43731d78a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d78a9 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348288:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623106.348290:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623106.348292:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623106.348305:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866784256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788623106.348340:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623106.348393:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784256 00000100:00100000:1.0:1788623106.348398:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784256 00010000:00010000:1.0:1788623106.348420:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d78a2 expref: 20 pid: 14318 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623106.348443:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788623106.348449:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+20:3280:x1875506866784256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788623106.348462:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623106.348466:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d78a2 expref: 20 pid: 14318 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348484:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d78a2 expref: 20 pid: 14318 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.348811:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13734000/0xef842f43731d78a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d78a2 expref: 20 pid: 14318 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349190:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349201:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788623106.349218:0:14313:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002911539s 00010000:00010000:1.0:1788623106.349223:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349232:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349240:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349247:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349253:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623106.349259:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349267:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349297:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623106.349310:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623106.349356:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3280:x1875506866784256:12345-0@lo:103:ldlm_bl.0 Request processed in 905us (1013us total) trans 0 rc 0/0 00010000:00010000:3.0:1788623106.349557:0:14342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623106.349568:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623106.349575:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735a00/0xef842f43731d79cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623106.349668:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788623106.349719:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866784256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788623106.357327:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:15728:x1875506866784000:12345-0@lo:253:mount.lustre.0 Request processed in 80401us (81928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623106.357347:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788623106.357467:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd2d9f5a-a1d8-466a-ac20-a19462995af0:15728:1875506866784000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788623106.357488:0:15728:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788623106.357554:0:15728:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788623106.357557:0:15728:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788623106.357559:0:15728:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788623106.357561:0:15728:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788623106.357562:0:15728:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788623106.357564:0:15728:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788623106.357566:0:15728:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788623106.357568:0:15728:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788623106.357570:0:15728:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788623106.357596:0:15728:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788623106.368037:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788623106.368208:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788623106.368513:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788623106.369032:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788623106.369185:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788623106.369682:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788623106.371270:0:15728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788623106.463077:0:15728:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788623106.463089:0:15728:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788623106.463122:0:15728:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788623106.463184:0:15728:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788623106.463198:0:15728:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788623106.463227:0:15728:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788623107.243993:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788623107.635121:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788623107.755848:0:14323:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788623107.755856:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff997e36e26000 from 8 10000000:01000000:0.0:1788623107.755861:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788623107.756058:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623107.756071:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623107.756097:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623107.756124:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866784384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788623107.756194:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623107.756250:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788623107.756449:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784384 00000100:00100000:1.0:1788623107.756457:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784384 00000100:00100000:1.0:1788623107.756588:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788623107.756598:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d010c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866784384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788623107.756611:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623107.756626:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e2f0db400/0xef842f43731d79dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d79d6 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623107.756650:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e2f0db400/0xef842f43731d79dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d79d6 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623107.756661:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e2f0db400/0xef842f43731d79dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d79d6 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623107.756670:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db400, rc 0) 00000100:00100000:1.0:1788623107.757432:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d010c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866784384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 831us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623107.757442:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788623107.758622:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866784384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788623107.758648:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79dd expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623107.758660:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d79dd expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623107.758781:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866784512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788623107.759419:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623107.759471:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e096d4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788623107.759582:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784512 00000100:00100000:1.0:1788623107.759590:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784512 00000100:00100000:1.0:1788623107.759711:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788623107.759725:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866784512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788623107.759779:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788623107.759802:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788623107.759805:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788623107.759907:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866784512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623107.759915:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788623107.759988:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866784512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788623107.760049:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788623107.760059:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79dd expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623107.760069:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8a00/0xef842f43731d79d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d79dd expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623108.267876:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623109.292033:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623110.193912:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788623110.193942:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866784640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788623110.194020:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623110.194413:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784640 00000100:00100000:1.0:1788623110.194424:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784640 00000100:00100000:1.0:1788623110.194505:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788623110.194517:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866784640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788623110.194556:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623110.194629:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866784640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623110.194636:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788623110.194786:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788623110.194827:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866784640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788623110.316363:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623111.339876:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788623111.723958:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788623111.723966:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788623111.723970:0:38:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788623111.723983:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff997e116ae000 using connection 192.168.204.119@tcp/0@lo 00000100:00100000:2.0:1788623111.724007:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff997e2eecb100 x1875506866785024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788623111.724072:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866784896:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.724135:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623111.724190:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788623111.724196:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3279:1875506866784768:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.724223:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623111.724244:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866785408:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.724264:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623111.724301:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866785024:0@lo:8:kworker.0 00000100:00100000:2.0:1788623111.724321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623111.724347:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866785152:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.724367:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623111.724381:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788623111.724385:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866785280:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.724401:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623111.724428:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784896 00000100:00100000:2.0:1788623111.724436:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784896 00000100:00100000:2.0:1788623111.724472:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785024 00000100:00100000:2.0:1788623111.724474:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785024 00000100:00100000:2.0:1788623111.724486:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623111.724508:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866784896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.724555:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866784896:12345-0@lo:400:kworker.0 Request processed in 48us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623111.724562:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788623111.724579:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788623111.724583:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3277:x1875506866785024:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788623111.724606:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1788623111.724633:0:15013:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xef842f43731d79e4 00002000:00100000:2.0:1788623111.724647:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff997e397c1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788623111.724651:0:15013:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788623111.724655:0:15013:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788623111.725018:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788623111.725042:0:15013:0:(import.c:65:import_set_state_nolock()) ffff997e397c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788623111.725082:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3277:x1875506866785024:12345-0@lo:8:kworker.0 Request processed in 497us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623111.725090:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788623111.725114:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866784768 00000100:00100000:2.0:1788623111.725118:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866784768 00000100:00100000:2.0:1788623111.725143:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788623111.725150:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3279:x1875506866784768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.725176:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3279:x1875506866784768:12345-0@lo:400:kworker.0 Request processed in 27us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623111.725181:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788623111.725205:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785408 00000100:00100000:2.0:1788623111.725208:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785408 00000100:00100000:2.0:1788623111.725236:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785152 00000100:00100000:2.0:1788623111.725245:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785152 00000100:00100000:2.0:1788623111.725259:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785280 00000100:00100000:2.0:1788623111.725261:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785280 00000100:00100000:2.0:1788623111.725274:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788623111.725280:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866785408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.725309:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866785408:12345-0@lo:400:kworker.0 Request processed in 30us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623111.725314:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788623111.725323:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788623111.725328:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866785152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.725355:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875506866785152:12345-0@lo:400:kworker.0 Request processed in 26us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623111.725360:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788623111.725370:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788623111.725375:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866785280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.725399:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875506866785280:12345-0@lo:400:kworker.0 Request processed in 24us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623111.725404:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788623111.725432:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788623111.725461:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2eecb100 x1875506866785024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788623136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788623111.725477:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788623111.725487:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788623111.725492:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788623111.725495:0:3277:0:(import.c:65:import_set_state_nolock()) ffff997e116ae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788623111.725507:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788623111.725513:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875506866785024:0@lo:8:kworker.0 00010000:00080000:2.0:1788623111.725558:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f192680 x1875506866785280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623111.725567:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875506866785280:0@lo:400:kworker.0 00010000:00080000:2.0:1788623111.725578:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f190a80 x1875506866785152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623111.725586:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875506866785152:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.725611:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3279:1875506866784768:0@lo:400:kworker.0 00010000:00080000:2.0:1788623111.725621:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2f190380 x1875506866785408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788623127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788623111.725629:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866785408:0@lo:400:kworker.0 00000100:00100000:2.0:1788623111.725639:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866784896:0@lo:400:kworker.0 00000004:00080000:3.0:1788623111.726061:0:14351:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788623111.726083:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14351:1875506866785664:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788623111.726123:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623111.726145:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff997d04596300 going to sleep for 11 seconds 00000004:00080000:3.0:1788623111.726161:0:14350:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788623111.726600:0:14350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435681856402ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788623111.726879:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788623111.726893:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623111.726931:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623111.726980:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785536 00000100:00100000:3.0:1788623111.726988:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785536 00000100:00100000:3.0:1788623111.727033:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788623111.727041:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866785536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788623111.727069:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788623111.727109:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875506866785536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623111.727115:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788623111.727136:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788623111.727161:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff997e2fd00700 x1875506866785536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788623127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788623111.727179:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623111.727572:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785664 00000100:00100000:3.0:1788623111.727577:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785664 00000100:00100000:3.0:1788623111.727602:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788623111.727608:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14351:x1875506866785664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788623111.734846:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788623111.734861:0:15013:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788623111.734867:0:15013:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788623111.750831:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.750845:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.750864:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.750869:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.750876:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.750915:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.750927:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.750936:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.750958:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.750973:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.750978:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.750986:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.750991:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.751000:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.751016:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.751023:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a6195b4/0xef842f43731d79eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.751050:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.751052:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.751054:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.759095:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.759109:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759126:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.759131:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.759137:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759151:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759161:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759168:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759187:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788623111.759618:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.759625:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759646:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.759649:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.759653:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759663:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759672:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759678:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.759704:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788623111.760109:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.760115:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760124:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.760127:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.760131:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760141:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760160:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760167:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760181:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788623111.760196:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788623111.760202:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760209:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.760214:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760224:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760241:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760248:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d79f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760267:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788623111.760277:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760283:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.760286:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760293:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760304:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760311:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc098b67/0xef842f43731d79f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760323:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.760326:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760332:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.760335:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760343:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760362:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760369:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7a00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760380:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.760382:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.760384:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.760854:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.760861:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760870:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.760873:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.760878:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760888:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760896:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760904:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760928:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.760937:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.760941:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760947:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.760950:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760959:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760969:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760976:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7a07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.760989:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.760991:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.760992:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.764543:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.764557:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764575:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.764589:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.764596:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764612:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764622:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764630:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764659:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.764678:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.764684:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764713:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.764718:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764728:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764770:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764789:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.764811:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.764813:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.764815:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.765256:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.765263:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765272:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.765276:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.765281:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765291:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765300:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765307:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765322:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.765331:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.765341:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765348:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.765351:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765359:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765370:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765379:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765394:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.765396:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.765397:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.765857:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.765864:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765874:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.765877:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.765881:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765903:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765911:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765918:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765945:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.765955:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.765959:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765966:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.765969:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765978:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.765989:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.767586:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.767629:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.767632:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.767634:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.772332:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.772346:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772364:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.772370:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.772377:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772399:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772409:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772415:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772433:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.772445:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.772450:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772472:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.772477:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772485:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772501:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772508:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.772530:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.772532:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.772533:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.773099:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.773106:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773116:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.773119:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.773124:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773134:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773148:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773155:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773170:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.773179:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.773183:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773189:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.773193:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773202:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773213:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773220:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773233:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.773240:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.773242:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.773664:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.773671:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773679:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.773683:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.773699:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773710:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773718:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773725:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773761:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.773770:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.773773:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773780:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.773783:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773804:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773816:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773824:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.773837:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.773839:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.773841:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.774220:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.774225:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.774234:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.774236:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.774241:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.774250:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623111.775308:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.775484:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788623111.776946:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788623111.777083:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.777107:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.777232:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788623111.780642:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.780656:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.780675:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.780680:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.780697:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.780724:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.780735:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.780759:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782578:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788623111.782592:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782605:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fae00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623111.782610:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782621:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782661:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782670:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782713:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623111.782718:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782724:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623111.782728:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782735:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782760:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.782768:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.782769:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.782771:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.782896:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788623111.782904:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7a3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788623111.783491:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.783498:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783509:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.783513:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.783519:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783530:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783539:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783547:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783566:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.783575:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.783580:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783586:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fbc00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.783590:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783605:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783616:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783624:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a477f72f/0xef842f43731d7a46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.783638:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.783639:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.783641:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.783809:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.784295:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.784302:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.784311:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.784314:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.784318:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.784328:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.784335:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.784349:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.784361:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788623111.784835:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623111.784841:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.784855:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fa000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623111.784860:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.784869:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.784883:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.784891:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7a4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.784909:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.784910:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.784912:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.785185:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.785191:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.785199:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.785203:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.785208:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.785217:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.785225:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.785233:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.785569:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788623111.786158:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.786166:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.786183:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.786187:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.786192:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.786203:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.786211:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.786219:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.791868:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788623111.791882:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.791896:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fa200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623111.791901:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.791912:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.791948:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.791957:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000560e5be9/0xef842f43731d7a54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.791990:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788623111.791995:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.792001:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623111.792005:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.792012:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.792021:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623111.792028:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.792030:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.792032:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.796003:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788623111.796021:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b132a02/0xef842f43731d7a5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.799026:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.802165:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.802180:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802198:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.802203:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.802210:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802240:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802251:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802259:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802284:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788623111.802732:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.802738:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802772:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.802776:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.802781:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802791:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802798:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802816:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802834:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788623111.802850:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788623111.802856:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802864:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.802869:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802879:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802895:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802904:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1adb050/0xef842f43731d7a62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802926:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.802929:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802947:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fba00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.802951:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802960:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802970:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802978:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758e8c76/0xef842f43731d7a69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.802993:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.802995:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.802997:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.803420:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.803426:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803436:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.803439:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.803444:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803454:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803469:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803474:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803497:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788623111.803959:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.803966:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803974:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.803978:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.803983:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.803992:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804000:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804007:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804034:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788623111.804047:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788623111.804052:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804060:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fac00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.804064:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804074:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804090:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804097:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d53a333/0xef842f43731d7a70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804115:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.804119:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804125:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734400 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.804129:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804149:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804159:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804166:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af93169c/0xef842f43731d7a77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.804180:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.804181:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.804183:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623111.804501:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.805481:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.807947:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.807963:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.807981:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.807986:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.807993:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.808008:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.808020:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.808041:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.808073:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623111.808594:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623111.808603:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.808612:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735200 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623111.808617:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.808627:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.808652:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.808660:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf099f3a/0xef842f43731d7a7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.808709:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623111.808712:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623111.808714:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.810904:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.810918:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.810947:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.810952:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.810958:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.810973:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.810983:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.810991:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.811052:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788623111.816216:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.816235:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.816261:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.816266:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.816273:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.816289:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.816300:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.816308:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816509:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788623111.816518:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816526:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623111.816531:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816541:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816559:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816566:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea0fa631/0xef842f43731d7a85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816586:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623111.816590:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816596:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623111.816606:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816615:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816625:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623111.816634:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623111.816635:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623111.816637:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.820405:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788623111.820420:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7a8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788623111.821115:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.821124:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821137:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.821141:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.821148:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821175:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821186:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821194:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821214:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.821227:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.821233:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821240:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735800 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.821245:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821255:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821284:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821293:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059162675/0xef842f43731d7a93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821315:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.821317:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.821319:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.821776:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.821783:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821792:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.821796:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.821800:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821809:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821818:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821825:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821842:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.821851:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.821856:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821873:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.821876:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821884:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821895:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821903:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec6ac945/0xef842f43731d7a9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.821917:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.821919:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.821921:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.822345:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.822351:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822360:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.822364:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.822368:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822379:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822393:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822400:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822418:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.822428:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.822432:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822438:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734600 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.822441:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822449:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822460:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822467:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032b8b496/0xef842f43731d7aa1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822481:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.822487:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.822489:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788623111.822938:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788623111.822944:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822953:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788623111.822956:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623111.822961:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822969:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822977:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.822984:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.823000:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788623111.823009:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788623111.823013:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.823020:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623111.823023:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.823043:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.823054:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.823061:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ced9661/0xef842f43731d7aa8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623111.823077:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.823079:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623111.823097:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623111.826194:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788623111.829568:0:15013:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788623111.829670:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14351:x1875506866785664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102057us (103541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623111.829681:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788623111.830083:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2fd02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14351:1875506866785664:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788623111.830101:0:14351:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788623111.830150:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14351:1875506866785792:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788623111.830199:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623111.830247:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788623111.832451:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785792 00000100:00100000:3.0:1788623111.832466:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785792 00000100:00100000:3.0:1788623111.832524:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788623111.832534:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14351:x1875506866785792:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788623111.832587:0:15012:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788623111.851498:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14351:x1875506866785792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18956us (21289us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788623111.851511:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788623111.851569:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14351:1875506866785792:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788623111.851595:0:14351:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1788623111.871727:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788623112.364912:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788623112.886337:0:16088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788623113.388368:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623114.415010:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623114.781995:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623114.782957:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402048 00000100:00100000:1.0:1788623114.782968:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402048 00000100:00100000:1.0:1788623114.783021:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 75 00000100:00100000:1.0:1788623114.783030:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1875506858402048:12345-192.168.204.19@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788623114.783065:0:14320:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b4a5d1e3-a8db-449a-a137-c2c20c345ee0@192.168.204.19@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1788623114.783096:0:14320:0:(genops.c:1385:class_connect()) connect: client b4a5d1e3-a8db-449a-a137-c2c20c345ee0, cookie 0xef842f43731d7aaf 00000100:00080000:1.0:1788623114.783238:0:14320:0:(import.c:65:import_set_state_nolock()) ffff997e41d34800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788623114.783323:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+5:2347:x1875506858402048:12345-192.168.204.19@tcp:250:mount.lustre.0 Request processed in 291us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623114.783331:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 75 00000100:00100000:2.0:1788623114.790852:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.790951:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402176 00000100:00100000:0.0:1788623114.790962:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402176 00000100:00100000:0.0:1788623114.791027:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:0.0:1788623114.791047:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+5:13736:x1875506858402176:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788623114.791065:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623114.791083:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9e00/0xef842f43731d7ab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb3f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623114.791111:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9e00/0xef842f43731d7ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb3f expref: 6 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623114.791123:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9e00/0xef842f43731d7ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb3f expref: 6 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623114.791133:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9e00, rc 0) 00000100:00100000:0.0:1788623114.791201:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+6:13736:x1875506858402176:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 164us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.791224:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 76 00000100:00100000:0.0:1788623114.796069:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623114.796171:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402304 00000100:00100000:2.0:1788623114.796184:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402304 00000100:00100000:2.0:1788623114.796243:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:2.0:1788623114.796254:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+6:13736:x1875506858402304:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788623114.796786:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+6:13736:x1875506858402304:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 532us (728us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788623114.796796:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 77 00000100:00100000:2.0:1788623114.800561:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623114.800688:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402432 00000100:00100000:1.0:1788623114.800697:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402432 00000100:00100000:1.0:1788623114.800863:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:1.0:1788623114.800883:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+6:13736:x1875506858402432:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788623114.800903:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623114.800924:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e2f0da400/0xef842f43731d7abd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb46 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623114.800960:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e2f0da400/0xef842f43731d7abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb46 expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623114.800973:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e2f0da400/0xef842f43731d7abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb46 expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623114.801003:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0da400, rc 0) 00000100:00100000:1.0:1788623114.801083:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+7:13736:x1875506858402432:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 209us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623114.801090:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 78 00000100:00100000:3.0:1788623114.804000:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.810708:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402560 00000100:00100000:0.0:1788623114.810723:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402560 00000100:00100000:0.0:1788623114.810808:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:0.0:1788623114.810818:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+7:13736:x1875506858402560:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788623114.813116:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13736:x1875506858402560:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 2286us (9114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.813132:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 79 00000100:00100000:2.0:1788623114.822292:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623114.825569:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402688 00000100:00100000:1.0:1788623114.825586:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402688 00000100:00100000:1.0:1788623114.825672:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:1.0:1788623114.825683:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13736:x1875506858402688:12345-192.168.204.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788623114.826294:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13736:x1875506858402688:12345-192.168.204.19@tcp:503:mount.lustre.0 Request processed in 610us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623114.826304:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 80 00000100:00100000:2.0:1788623114.843391:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.845114:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402816 00000100:00100000:0.0:1788623114.845130:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402816 00000100:00100000:0.0:1788623114.845197:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:0.0:1788623114.845206:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13755:x1875506858402816:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788623114.845583:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13755:x1875506858402816:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 376us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.845591:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 81 00000100:00100000:3.0:1788623114.871362:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623114.871520:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858402944 00000100:00100000:1.0:1788623114.871530:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858402944 00000100:00100000:1.0:1788623114.871587:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:1.0:1788623114.871597:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13755:x1875506858402944:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788623114.872018:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13755:x1875506858402944:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 420us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.872027:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 82 00000100:00100000:3.0:1788623114.883490:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623114.883677:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403072 00000100:00100000:2.0:1788623114.883691:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403072 00000100:00100000:2.0:1788623114.883789:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:2.0:1788623114.883799:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+8:13736:x1875506858403072:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788623114.883819:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623114.883839:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fac00/0xef842f43731d7ac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb70 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623114.883871:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fac00/0xef842f43731d7ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb70 expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623114.883885:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fac00/0xef842f43731d7ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb70 expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623114.883895:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fac00, rc 0) 00000100:00100000:2.0:1788623114.883987:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+9:13736:x1875506858403072:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 189us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623114.884009:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 83 00000100:00100000:2.0:1788623114.886894:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.888481:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403200 00000100:00100000:0.0:1788623114.888502:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403200 00000100:00100000:0.0:1788623114.888678:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 84 00000100:00100000:0.0:1788623114.888691:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+9:13736:x1875506858403200:12345-192.168.204.19@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788623114.888727:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788623114.888809:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788623114.888814:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788623114.888818:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788623114.888821:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788623114.890890:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+9:13736:x1875506858403200:12345-192.168.204.19@tcp:256:mount.lustre.0 Request processed in 2190us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.890906:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 84 00000100:00100000:3.0:1788623114.894659:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.894998:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403328 00000100:00100000:0.0:1788623114.895013:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403328 00000100:00100000:0.0:1788623114.895087:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 85 00000100:00100000:0.0:1788623114.895101:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+9:13736:x1875506858403328:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788623114.895126:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623114.895163:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eb77 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623114.895205:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 10 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623114.895220:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 10 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623114.895231:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8200, rc 0) 00000100:00100000:0.0:1788623114.895313:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13736:x1875506858403328:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 215us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.895321:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 85 00000100:00100000:3.0:1788623114.899320:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.900266:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403456 00000100:00100000:0.0:1788623114.900281:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403456 00000100:00100000:0.0:1788623114.900369:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 86 00000100:00100000:0.0:1788623114.900382:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13736:x1875506858403456:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788623114.900867:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13736:x1875506858403456:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 486us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.900876:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 86 00000100:00100000:3.0:1788623114.902824:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623114.903064:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403584 00000100:00100000:2.0:1788623114.903078:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403584 00000100:00100000:2.0:1788623114.903140:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:2.0:1788623114.903270:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d04e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13736:x1875506858403584:12345-192.168.204.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788623114.903641:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d04e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13736:x1875506858403584:12345-192.168.204.19@tcp:503:mount.lustre.0 Request processed in 491us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623114.903649:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 87 00000100:00100000:2.0:1788623114.907482:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.914129:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403712 00000100:00100000:0.0:1788623114.915001:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403712 00000100:00100000:0.0:1788623114.915120:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 88 00000100:00100000:0.0:1788623114.915133:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13759:x1875506858403712:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788623114.916402:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13759:x1875506858403712:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 1260us (8923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623114.916416:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 88 00000100:00100000:3.0:1788623114.925127:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623114.929376:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403840 00000100:00100000:0.0:1788623114.929403:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403840 00000100:00100000:0.0:1788623114.929497:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 89 00000100:00100000:0.0:1788623114.929510:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13759:x1875506858403840:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788623114.931147:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13759:x1875506858403840:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 1624us (6019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623114.931163:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 89 00000100:00100000:2.0:1788623114.958508:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623114.960048:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858403968 00000100:00100000:1.0:1788623114.960066:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858403968 00000100:00100000:1.0:1788623114.960140:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788623114.960152:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1875506858403968:12345-192.168.204.19@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788623114.960194:0:14328:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from da67b507-6848-4965-872f-6899e670b6fc@192.168.204.19@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1788623114.960265:0:14328:0:(genops.c:1385:class_connect()) connect: client da67b507-6848-4965-872f-6899e670b6fc, cookie 0xef842f43731d7ad2 00000004:00100000:1.0:1788623114.960323:0:14328:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788623114.960331:0:14328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788623115.042726:0:14328:0:(import.c:65:import_set_state_nolock()) ffff997e078f1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788623115.043068:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+6:2347:x1875506858403968:12345-192.168.204.19@tcp:38:mount.lustre.0 Request processed in 82913us (84573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623115.043081:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:2.0:1788623115.049804:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623115.049907:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404096 00000100:00100000:3.0:1788623115.049920:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404096 00000100:00100000:3.0:1788623115.050028:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788623115.050042:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:0:x1875506858404096:12345-192.168.204.19@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788623115.050128:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788623115.050295:0:14327:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788623115.050595:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:0:x1875506858404096:12345-192.168.204.19@tcp:41:mount.lustre.0 Request processed in 555us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623115.050604:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788623115.053089:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623115.053313:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404224 00000100:00100000:2.0:1788623115.053328:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404224 00000100:00100000:2.0:1788623115.053528:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:2.0:1788623115.053541:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+6:13736:x1875506858404224:12345-192.168.204.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788623115.053581:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788623115.053689:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+6:13736:x1875506858404224:12345-192.168.204.19@tcp:41:mount.lustre.0 Request processed in 150us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623115.053697:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:2.0:1788623115.057214:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623115.059980:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404352 00000100:00100000:0.0:1788623115.060004:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404352 00000100:00100000:0.0:1788623115.060109:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:0.0:1788623115.060123:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+6:13736:x1875506858404352:12345-192.168.204.19@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788623115.060270:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+6:13736:x1875506858404352:12345-192.168.204.19@tcp:40:mount.lustre.0 Request processed in 149us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623115.060278:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:3.0:1788623115.063170:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623115.063218:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623115.063348:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623115.064184:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404736 00000100:00100000:1.0:1788623115.064199:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404736 00000100:00100000:1.0:1788623115.064277:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:1.0:1788623115.064289:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+6:13736:x1875506858404736:12345-192.168.204.19@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788623115.065272:0:14329:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 892us 00000100:00100000:0.0:1788623115.065779:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404480 00000100:00100000:2.0:1788623115.065782:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404608 00000100:00100000:2.0:1788623115.065796:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404608 00000100:00100000:2.0:1788623115.065843:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:2.0:1788623115.065853:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858404608:12345-192.168.204.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788623115.065900:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from da67b507-6848-4965-872f-6899e670b6fc@192.168.204.19@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788623115.065942:0:15013:0:(genops.c:1385:class_connect()) connect: client da67b507-6848-4965-872f-6899e670b6fc, cookie 0xef842f43731d7ad9 00002000:00100000:2.0:1788623115.065958:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da67b507-6848-4965-872f-6899e670b6fc/ffff997e397c7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788623115.065997:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00000100:00100000:0.0:1788623115.065997:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404480 00002000:00080000:2.0:1788623115.066259:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788623115.066303:0:15013:0:(import.c:65:import_set_state_nolock()) ffff997e397c6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788623115.066665:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+6:2347:x1875506858404608:12345-192.168.204.19@tcp:8:mount.lustre.0 Request processed in 810us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623115.066674:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:2.0:1788623115.066698:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788623115.066704:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858404480:12345-192.168.204.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788623115.066722:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from da67b507-6848-4965-872f-6899e670b6fc@192.168.204.19@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788623115.066969:0:15013:0:(genops.c:1385:class_connect()) connect: client da67b507-6848-4965-872f-6899e670b6fc, cookie 0xef842f43731d7ae0 00002000:00100000:2.0:1788623115.066980:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da67b507-6848-4965-872f-6899e670b6fc/ffff997e397c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788623115.067000:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788623115.067808:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788623115.067846:0:15013:0:(import.c:65:import_set_state_nolock()) ffff997e397c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788623115.067969:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+6:2347:x1875506858404480:12345-192.168.204.19@tcp:8:mount.lustre.0 Request processed in 1263us (4814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623115.067978:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000004:00200000:1.0:1788623115.102280:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788623115.102459:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+6:13736:x1875506858404736:12345-192.168.204.19@tcp:33:mount.lustre.0 Request processed in 38161us (39099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623115.102472:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:0.0:1788623115.308279:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788623115.308315:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866785920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788623115.308461:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623115.308866:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866785920 00000100:00100000:3.0:1788623115.308884:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866785920 00000100:00100000:3.0:1788623115.308969:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788623115.309259:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788623115.309338:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866785920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788623115.309369:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788623115.309459:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866785920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623115.309531:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866785920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788623115.311550:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788623115.332386:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623115.332507:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404864 00000100:00100000:1.0:1788623115.332521:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404864 00000100:00100000:1.0:1788623115.332601:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:1.0:1788623115.332614:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+6:13780:x1875506858404864:12345-192.168.204.19@tcp:101:mkdir.0 00010000:00010000:1.0:1788623115.332650:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623115.332683:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eba1 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623115.332795:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7aee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623115.332810:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623115.332847:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623115.332893:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788623115.332896:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623115.332948:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623115.332977:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbc00/0xef842f43731d7ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eba1 expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623115.332997:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7aee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eba1 expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623115.333008:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:1.0:1788623115.333011:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788623115.333015:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dac00, rc 0) 00000100:00100000:1.0:1788623115.333098:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+7:13780:x1875506858404864:12345-192.168.204.19@tcp:101:mkdir.0 Request processed in 487us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623115.333105:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00010000:00010000:1.0:1788623115.436708:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788623115.889375:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da67b507-6848-4965-872f-6899e670b6fc 00010000:00010000:3.0:1788623116.460180:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623116.845857:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866786048:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.845958:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623116.846016:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866786560:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.846069:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623116.846102:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788623116.846108:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866786432:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.846134:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623116.846164:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.846195:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623116.846217:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788623116.846223:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866786176:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.846246:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623116.846265:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2f193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866786688:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.846288:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623116.847506:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786048 00000100:00100000:1.0:1788623116.847519:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786048 00000100:00100000:1.0:1788623116.847582:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788623116.847606:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3281:x1875506866786048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623116.847696:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3281:x1875506866786048:12345-0@lo:400:kworker.0 Request processed in 105us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623116.847718:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788623116.847841:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786304 00000100:00100000:0.0:1788623116.847846:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786304 00000100:00100000:0.0:1788623116.847889:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786176 00000100:00100000:0.0:1788623116.847893:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786176 00000100:00100000:0.0:1788623116.847910:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788623116.847916:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866786304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623116.847958:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866786304:12345-0@lo:400:kworker.0 Request processed in 42us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623116.847964:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788623116.847977:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788623116.847984:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866786176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623116.848013:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866786176:12345-0@lo:400:kworker.0 Request processed in 31us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623116.848020:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788623116.848654:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866786304:0@lo:400:kworker.0 00000100:00100000:2.0:1788623116.848690:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866786816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788623116.848732:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623116.848788:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866786176:0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.849136:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786560 00000100:00100000:3.0:1788623116.849145:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786560 00000100:00100000:3.0:1788623116.849249:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786432 00000100:00100000:3.0:1788623116.849253:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786432 00000100:00100000:3.0:1788623116.849269:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786688 00000100:00100000:3.0:1788623116.849272:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786688 00000100:00100000:3.0:1788623116.849413:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788623116.849424:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866786560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.849483:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866786560:12345-0@lo:400:kworker.0 Request processed in 62us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623116.849490:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788623116.849507:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788623116.849512:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866786432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.849539:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866786432:12345-0@lo:400:kworker.0 Request processed in 27us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623116.849545:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788623116.849556:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788623116.849561:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866786688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.849625:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875506866786688:12345-0@lo:400:kworker.0 Request processed in 63us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623116.849631:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788623116.849673:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786816 00000100:00100000:3.0:1788623116.849677:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786816 00000100:00100000:3.0:1788623116.849701:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788623116.849707:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866786816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788623116.849728:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788623116.849841:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875506866786816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623116.849848:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788623116.849914:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866786816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623116.849936:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875506866786688:0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.850004:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866786432:0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.850017:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866786048:0@lo:400:kworker.0 00000100:00100000:3.0:1788623116.850030:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2f192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866786560:0@lo:400:kworker.0 00000100:00080000:3.0:1788623116.850069:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788623116.850075:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788623116.955884:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da67b507-6848-4965-872f-6899e670b6fc 00000001:00080000:3.0:1788623116.955919:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1788623117.454403:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623117.454907:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858404992 00000100:00100000:0.0:1788623117.454922:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858404992 00000100:00080000:3.0:1788623117.454994:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623117.455074:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:0.0:1788623117.455087:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fd00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+7:13832:x1875506858404992:12345-192.168.204.19@tcp:41:lfs.0 00000004:00000024:0.0:1788623117.455149:0:14327:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788623117.455268:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fd00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+7:13832:x1875506858404992:12345-192.168.204.19@tcp:41:lfs.0 Request processed in 183us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623117.455276:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:3.0:1788623117.458047:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623117.458407:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405120 00000100:00100000:2.0:1788623117.458420:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405120 00000100:00100000:2.0:1788623117.458514:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:2.0:1788623117.458526:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da67b507-6848-4965-872f-6899e670b6fc+5:13832:x1875506858405120:12345-192.168.204.19@tcp:13:lfs.0 00002000:00000024:2.0:1788623117.458588:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623117.458707:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da67b507-6848-4965-872f-6899e670b6fc+5:13832:x1875506858405120:12345-192.168.204.19@tcp:13:lfs.0 Request processed in 183us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.458715:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00080000:3.0:1788623117.459066:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788623117.460795:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623117.460950:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405248 00000100:00100000:2.0:1788623117.460975:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405248 00000100:00100000:2.0:1788623117.461056:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:2.0:1788623117.461067:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da67b507-6848-4965-872f-6899e670b6fc+5:13832:x1875506858405248:12345-192.168.204.19@tcp:13:lfs.0 00002000:00000024:2.0:1788623117.461111:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623117.461215:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da67b507-6848-4965-872f-6899e670b6fc+5:13832:x1875506858405248:12345-192.168.204.19@tcp:13:lfs.0 Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.461223:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00080000:3.0:1788623117.461453:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788623117.484182:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623117.680310:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623117.680461:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405376 00000100:00100000:2.0:1788623117.680475:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405376 00000100:00100000:2.0:1788623117.680549:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 91 00000100:00100000:2.0:1788623117.680561:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+10:13862:x1875506858405376:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788623117.680599:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623117.680622:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fbc00/0xef842f43731d7af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eba8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623117.680665:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fbc00/0xef842f43731d7af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eba8 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623117.680679:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fbc00/0xef842f43731d7af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eba8 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623117.680699:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fbc00, rc 0) 00000100:00100000:2.0:1788623117.680963:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13862:x1875506858405376:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 403us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.680971:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 91 00000100:00100000:1.0:1788623117.683078:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.683169:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405504 00000100:00100000:3.0:1788623117.683182:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405504 00000100:00100000:3.0:1788623117.683242:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 92 00000100:00100000:3.0:1788623117.683253:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13862:x1875506858405504:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788623117.683675:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13862:x1875506858405504:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 421us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623117.683685:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 92 00000100:00100000:3.0:1788623117.704537:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623117.704714:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405632 00000100:00100000:1.0:1788623117.704728:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405632 00000100:00100000:1.0:1788623117.705242:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 93 00000100:00100000:1.0:1788623117.705255:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13862:x1875506858405632:12345-192.168.204.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788623117.709294:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13862:x1875506858405632:12345-192.168.204.19@tcp:503:mount.lustre.0 Request processed in 4023us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623117.709316:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 93 00000100:00100000:1.0:1788623117.722896:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623117.723207:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405760 00000100:00100000:2.0:1788623117.723239:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405760 00000100:00100000:2.0:1788623117.723320:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 94 00000100:00100000:2.0:1788623117.723332:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13871:x1875506858405760:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788623117.723951:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13871:x1875506858405760:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 618us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.723961:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 94 00000100:00100000:2.0:1788623117.761251:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623117.761534:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858405888 00000100:00100000:1.0:1788623117.761548:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858405888 00000100:00100000:1.0:1788623117.761964:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 95 00000100:00100000:1.0:1788623117.762045:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13871:x1875506858405888:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788623117.768549:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13871:x1875506858405888:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 6489us (7297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623117.768580:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 95 00000100:00100000:0.0:1788623117.778409:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623117.778690:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406016 00000100:00100000:2.0:1788623117.778705:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406016 00000100:00100000:2.0:1788623117.778824:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 96 00000100:00100000:2.0:1788623117.778838:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13862:x1875506858406016:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788623117.778860:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623117.778885:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fb600/0xef842f43731d7afc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ebd2 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623117.778924:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fb600/0xef842f43731d7afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd2 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623117.778938:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fb600/0xef842f43731d7afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd2 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623117.778950:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fb600, rc 0) 00000100:00100000:2.0:1788623117.779037:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13862:x1875506858406016:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 201us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.779045:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 96 00000100:00100000:3.0:1788623117.791365:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623117.791716:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406144 00000100:00100000:1.0:1788623117.791731:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406144 00000100:00100000:1.0:1788623117.791924:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 97 00000100:00100000:1.0:1788623117.791936:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13862:x1875506858406144:12345-192.168.204.19@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788623117.791985:0:14321:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788623117.792020:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788623117.792025:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788623117.792035:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788623117.792038:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788623117.813251:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13862:x1875506858406144:12345-192.168.204.19@tcp:256:mount.lustre.0 Request processed in 21296us (21881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623117.813274:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 97 00000100:00100000:0.0:1788623117.822036:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.822527:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406272 00000100:00100000:3.0:1788623117.822540:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406272 00000100:00100000:3.0:1788623117.822641:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 98 00000100:00100000:3.0:1788623117.822655:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13862:x1875506858406272:12345-192.168.204.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788623117.822681:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623117.822707:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ebd9 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623117.822791:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623117.822817:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623117.822830:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734600, rc 0) 00000100:00100000:3.0:1788623117.822919:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13862:x1875506858406272:12345-192.168.204.19@tcp:101:mount.lustre.0 Request processed in 267us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623117.822949:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 98 00000100:00100000:1.0:1788623117.825709:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623117.825850:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406400 00000100:00100000:0.0:1788623117.825864:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406400 00000100:00100000:0.0:1788623117.825931:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 99 00000100:00100000:0.0:1788623117.825943:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13862:x1875506858406400:12345-192.168.204.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788623117.826659:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13862:x1875506858406400:12345-192.168.204.19@tcp:501:mount.lustre.0 Request processed in 714us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623117.826671:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 99 00000100:00100000:1.0:1788623117.831900:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623117.832055:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406528 00000100:00100000:0.0:1788623117.832068:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406528 00000100:00100000:0.0:1788623117.832456:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 100 00000100:00100000:0.0:1788623117.832469:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13862:x1875506858406528:12345-192.168.204.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788623117.835509:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13862:x1875506858406528:12345-192.168.204.19@tcp:503:mount.lustre.0 Request processed in 3026us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623117.835530:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 100 00000100:00100000:1.0:1788623117.842350:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623117.843552:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406656 00000100:00100000:2.0:1788623117.843580:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406656 00000100:00100000:2.0:1788623117.843695:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 101 00000100:00100000:2.0:1788623117.843709:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13877:x1875506858406656:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788623117.844390:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13877:x1875506858406656:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 681us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.844400:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 101 00000100:00100000:1.0:1788623117.848924:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623117.851171:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406784 00000100:00100000:0.0:1788623117.851191:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406784 00000100:00100000:0.0:1788623117.851290:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 102 00000100:00100000:0.0:1788623117.851305:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13877:x1875506858406784:12345-192.168.204.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788623117.851693:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13877:x1875506858406784:12345-192.168.204.19@tcp:502:llog_process_th.0 Request processed in 390us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623117.851704:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 102 00000100:00100000:1.0:1788623117.862993:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623117.863042:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623117.863084:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623117.863132:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.863325:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407424 00000100:00100000:3.0:1788623117.863339:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407424 00000100:00100000:3.0:1788623117.863420:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407552 00000100:00100000:3.0:1788623117.863423:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407552 00000100:00100000:3.0:1788623117.863445:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788623117.863456:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858407424:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623117.863560:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858407424:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 106us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623117.863580:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788623117.863600:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:3.0:1788623117.863606:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858407552:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623117.863633:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858407552:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623117.863639:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:2.0:1788623117.863907:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407296 00000100:00100000:2.0:1788623117.863924:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407296 00000100:00100000:2.0:1788623117.863965:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858406912 00000100:00100000:2.0:1788623117.863968:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858406912 00000100:00100000:2.0:1788623117.863990:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:2.0:1788623117.863997:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+7:2351:x1875506858407296:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:2.0:1788623117.864042:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+7:2351:x1875506858407296:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 45us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.864048:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:2.0:1788623117.864062:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788623117.864066:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1875506858406912:12345-192.168.204.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788623117.864108:0:15742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7913ea46-1c5d-4f6e-a105-ceba586b48a3@192.168.204.19@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1788623117.864161:0:15742:0:(genops.c:1385:class_connect()) connect: client 7913ea46-1c5d-4f6e-a105-ceba586b48a3, cookie 0xef842f43731d7b0a 00000004:00100000:2.0:1788623117.864213:0:15742:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788623117.864561:0:15742:0:(import.c:65:import_set_state_nolock()) ffff997e397c2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788623117.864607:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2347:x1875506858406912:12345-192.168.204.19@tcp:38:mount.lustre.0 Request processed in 539us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.864615:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000040:00080000:1.0:1788623117.870562:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788623117.872784:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.873086:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623117.873777:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407168 00000100:00100000:0.0:1788623117.873793:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407168 00000100:00100000:0.0:1788623117.873887:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407040 00000100:00100000:0.0:1788623117.873891:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407040 00000100:00100000:0.0:1788623117.873916:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:0.0:1788623117.873929:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:13862:x1875506858407168:12345-192.168.204.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788623117.873971:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788623117.874220:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:2.0:1788623117.874230:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:0:x1875506858407040:12345-192.168.204.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788623117.874262:0:15742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788623117.874357:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:0:x1875506858407040:12345-192.168.204.19@tcp:41:mount.lustre.0 Request processed in 128us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.874365:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:0.0:1788623117.874591:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:13862:x1875506858407168:12345-192.168.204.19@tcp:41:mount.lustre.0 Request processed in 664us (1862us total) trans 0 rc 0/0 00000100:00080000:3.0:1788623117.874712:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623117.875603:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:1.0:1788623117.879884:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.880604:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407680 00000100:00100000:3.0:1788623117.880620:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407680 00000100:00100000:3.0:1788623117.880706:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:3.0:1788623117.880720:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:13862:x1875506858407680:12345-192.168.204.19@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788623117.880880:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:13862:x1875506858407680:12345-192.168.204.19@tcp:40:mount.lustre.0 Request processed in 164us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623117.880888:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:3.0:1788623117.884047:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.884652:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.884782:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623117.884833:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407808 00000100:00100000:3.0:1788623117.884846:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407808 00000100:00100000:3.0:1788623117.884889:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858407936 00000100:00100000:3.0:1788623117.884893:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858407936 00000100:00100000:3.0:1788623117.884909:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788623117.884919:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858407808:12345-192.168.204.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788623117.884963:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7913ea46-1c5d-4f6e-a105-ceba586b48a3@192.168.204.19@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:3.0:1788623117.885530:0:15013:0:(genops.c:1385:class_connect()) connect: client 7913ea46-1c5d-4f6e-a105-ceba586b48a3, cookie 0xef842f43731d7b11 00002000:00100000:3.0:1788623117.885547:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7913ea46-1c5d-4f6e-a105-ceba586b48a3/ffff997d06a05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788623117.885562:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788623117.885940:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788623117.885986:0:15013:0:(import.c:65:import_set_state_nolock()) ffff997d06a04800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788623117.886791:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408064 00000100:00100000:1.0:1788623117.886810:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408064 00000100:00100000:1.0:1788623117.886864:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:1.0:1788623117.886874:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:13862:x1875506858408064:12345-192.168.204.19@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788623117.886960:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788623117.887065:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:13862:x1875506858408064:12345-192.168.204.19@tcp:33:mount.lustre.0 Request processed in 193us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623117.887075:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:2.0:1788623117.888643:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2347:x1875506858407808:12345-192.168.204.19@tcp:8:mount.lustre.0 Request processed in 3713us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.888658:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:2.0:1788623117.888689:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:2.0:1788623117.888697:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875506858407936:12345-192.168.204.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788623117.888734:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7913ea46-1c5d-4f6e-a105-ceba586b48a3@192.168.204.19@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1788623117.888821:0:15013:0:(genops.c:1385:class_connect()) connect: client 7913ea46-1c5d-4f6e-a105-ceba586b48a3, cookie 0xef842f43731d7b18 00002000:00100000:2.0:1788623117.888836:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7913ea46-1c5d-4f6e-a105-ceba586b48a3/ffff997e07b09800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788623117.888849:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788623117.889548:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788623117.889617:0:15013:0:(import.c:65:import_set_state_nolock()) ffff997e07b08000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788623117.889672:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2347:x1875506858407936:12345-192.168.204.19@tcp:8:mount.lustre.0 Request processed in 972us (4928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623117.889681:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:3.0:1788623118.105116:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623118.105303:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408192 00000100:00100000:0.0:1788623118.105318:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408192 00000100:00100000:0.0:1788623118.105408:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:0.0:1788623118.105421:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:13898:x1875506858408192:12345-192.168.204.19@tcp:101:mkdir.0 00010000:00010000:0.0:1788623118.105449:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623118.105483:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec03 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623118.105593:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623118.105611:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623118.105629:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623118.105682:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788623118.105687:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623118.105794:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623118.105842:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623118.105865:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623118.105874:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:0.0:1788623118.105878:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788623118.105883:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8e00, rc 0) 00000100:00100000:0.0:1788623118.105958:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:13898:x1875506858408192:12345-192.168.204.19@tcp:101:mkdir.0 Request processed in 539us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623118.105965:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00010000:00010000:1.0:1788623118.508046:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788623119.532564:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623120.428059:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788623120.428090:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866786944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788623120.428193:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623120.428379:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866786944 00000100:00100000:1.0:1788623120.428391:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866786944 00000100:00100000:1.0:1788623120.428472:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788623120.428486:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866786944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788623120.428544:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623120.428676:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866786944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623120.428700:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788623120.428994:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788623120.429042:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866786944:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788623120.481319:0:5831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da67b507-6848-4965-872f-6899e670b6fc 00000001:00100000:2.0:1788623120.481341:0:5831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7913ea46-1c5d-4f6e-a105-ceba586b48a3 00010000:00010000:2.0:1788623120.556403:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788623120.991244:0:6680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7913ea46-1c5d-4f6e-a105-ceba586b48a3 00000001:02000400:1.0:1788623121.047058:0:16294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788623121.580013:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623121.965505:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788623121.965538:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866787072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788623121.965636:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623121.965721:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866787072 00000100:00100000:1.0:1788623121.965731:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866787072 00000100:00100000:1.0:1788623121.965830:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788623121.965842:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866787072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788623121.965887:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788623121.965948:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866787072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623121.965956:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788623121.965982:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788623121.966018:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788623121.966064:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866787072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788623121.972459:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3278:1875506866787200:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.972583:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623121.972640:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866787712:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.972682:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623121.972718:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788623121.972724:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866787328:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.972782:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623121.972847:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866787584:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.972879:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623121.972903:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788623121.972909:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3a315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866787456:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.972936:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623121.972975:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866787200 00000100:00100000:1.0:1788623121.972986:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866787200 00000100:00100000:1.0:1788623121.973057:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788623121.973070:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2fdf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3278:x1875506866787200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.973140:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2fdf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3278:x1875506866787200:12345-0@lo:400:kworker.0 Request processed in 74us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623121.973149:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788623121.973188:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866787712 00000100:00100000:0.0:1788623121.974203:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866787584 00000100:00100000:0.0:1788623121.974214:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866787584 00000100:00100000:0.0:1788623121.974264:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866787456 00000100:00100000:0.0:1788623121.974267:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866787456 00000100:00100000:0.0:1788623121.974282:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788623121.974290:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866787584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623121.974355:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866787584:12345-0@lo:400:kworker.0 Request processed in 66us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623121.974375:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788623121.974388:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788623121.974393:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866787456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623121.974420:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875506866787456:12345-0@lo:400:kworker.0 Request processed in 26us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623121.974426:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788623121.974443:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866787328 00000100:00100000:0.0:1788623121.974446:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866787328 00000100:00100000:0.0:1788623121.974469:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788623121.974474:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866787328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.974868:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866787712 00000100:00100000:1.0:1788623121.974903:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788623121.974909:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866787712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.974945:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875506866787712:12345-0@lo:400:kworker.0 Request processed in 37us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623121.974952:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788623121.974979:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623121.975022:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875506866787456:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.975032:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866787584:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.975069:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3278:1875506866787200:0@lo:400:kworker.0 00000100:00100000:1.0:1788623121.975080:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875506866787712:0@lo:400:kworker.0 00000100:00100000:0.0:1788623121.975631:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866787328:12345-0@lo:400:kworker.0 Request processed in 1153us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623121.975640:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788623121.976476:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3a317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866787328:0@lo:400:kworker.0 00000001:00100000:3.0:1788623122.050201:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7913ea46-1c5d-4f6e-a105-ceba586b48a3 00010000:00010000:3.0:1788623122.607214:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623123.162816:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.162865:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.162885:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.162926:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.162949:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.162967:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.162991:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623123.163019:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408704 00000100:00100000:1.0:1788623123.163032:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408704 00000100:00100000:1.0:1788623123.163099:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408960 00000100:00100000:1.0:1788623123.163102:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408960 00000100:00100000:1.0:1788623123.163119:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408576 00000100:00100000:1.0:1788623123.163122:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408576 00000100:00100000:1.0:1788623123.163136:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409088 00000100:00100000:1.0:1788623123.163139:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409088 00000100:00100000:1.0:1788623123.163159:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:1.0:1788623123.163172:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2350:x1875506858408704:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163263:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2350:x1875506858408704:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 94us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163271:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:1.0:1788623123.163291:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:1.0:1788623123.163298:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2350:x1875506858408960:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163323:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2350:x1875506858408960:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163329:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:1.0:1788623123.163340:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:1.0:1788623123.163346:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2350:x1875506858408576:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163383:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2350:x1875506858408576:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 37us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163391:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:1.0:1788623123.163403:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:1.0:1788623123.163410:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2350:x1875506858409088:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163432:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2350:x1875506858409088:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163439:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:1.0:1788623123.163459:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408320 00000100:00100000:1.0:1788623123.163463:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408320 00000100:00100000:1.0:1788623123.163502:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 104 00000100:00100000:1.0:1788623123.163510:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2350:x1875506858408320:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163534:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2350:x1875506858408320:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163539:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 104 00000100:00100000:1.0:1788623123.163571:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408448 00000100:00100000:1.0:1788623123.163575:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408448 00000100:00100000:1.0:1788623123.163603:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858408832 00000100:00100000:1.0:1788623123.163606:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858408832 00000100:00100000:1.0:1788623123.163628:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:1.0:1788623123.163635:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:2350:x1875506858408448:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163663:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:2350:x1875506858408448:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 30us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163669:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:1.0:1788623123.163680:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788623123.163693:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2350:x1875506858408832:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623123.163716:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2350:x1875506858408832:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 24us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623123.163721:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00080000:1.0:1788623123.163738:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788623123.163767:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788623123.163769:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788623123.630659:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788623124.656799:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788623124.702154:0:16444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8ec1d140 20000000:00000080:2.0:1788623124.702220:0:16444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff997d062c8c00 uarg=0000000000000000 20000000:01000000:2.0:1788623124.702280:0:16444:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788623124.702289:0:16444:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788623124.702295:0:16444:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788623124.703611:0:16445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788623124.704036:0:16444:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788623124.709967:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788623124.710311:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710342:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d781d expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710351:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d786a expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710382:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d799e expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710400:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710410:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710420:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710500:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710521:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 12 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623124.710541:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866787840:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623124.710701:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710710:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623124.710719:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866787968:192.168.204.19@tcp:104: 00010000:00010000:3.0:1788623124.710787:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d799e expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710808:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d799e expref: 18 pid: 14320 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623124.710819:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866788096:0@lo:104: 00000100:00100000:3.0:1788623124.710874:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788623124.710921:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d786a expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710929:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d786a expref: 18 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623124.710937:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866788224:0@lo:104: 00000100:00100000:3.0:1788623124.710958:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788623124.710985:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xef842f43731d781d expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.710993:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xef842f43731d781d expref: 18 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623124.711001:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866788352:0@lo:104: 00000100:00100000:3.0:1788623124.711029:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623124.711040:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e0840a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788623124.712352:0:14309:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788623124.712376:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788096 00000100:00100000:0.0:1788623124.712386:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788096 00000100:00100000:0.0:1788623124.712453:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788224 00000100:00100000:0.0:1788623124.712456:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788224 00000100:00100000:0.0:1788623124.712469:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788352 00000100:00100000:0.0:1788623124.712471:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788352 00000100:00100000:0.0:1788623124.712487:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788623124.712498:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+5:16444:x1875506866788096:12345-0@lo:104: 00010000:00010000:0.0:1788623124.712516:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.712615:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788623124.712622:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+5:16444:x1875506866788096:12345-0@lo:104: Request processed in 126us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623124.712644:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788623124.712768:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788623124.712777:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623124.712778:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788623124.712784:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+4:16444:x1875506866788224:12345-0@lo:104: 00010000:00010000:1.0:1788623124.712786:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9c00 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:1.0:1788623124.712791:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.712794:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712802:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788623124.712811:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623124.712817:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788623124.712831:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788623124.712835:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+4:16444:x1875506866788224:12345-0@lo:104: Request processed in 52us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623124.712841:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788623124.712851:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788623124.712856:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3751cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:16444:x1875506866788352:12345-0@lo:104: 00010000:00010000:0.0:1788623124.712862:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712863:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712871:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788623124.712893:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788623124.712897:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623124.712898:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3751cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+3:16444:x1875506866788352:12345-0@lo:104: Request processed in 43us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623124.712904:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788623124.712905:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e373b9c00/0xef842f43731d799e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d79a5 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712927:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788623124.712930:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712935:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9000 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:1.0:1788623124.712938:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712946:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.712948:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1788623124.712953:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.712954:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788623124.712960:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788623124.712961:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0db600 already unused, calling callback (ffffffffc1bcdc20) 10000000:00010000:0.0:1788623124.712964:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712975:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.712981:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788623124.712983:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788623124.712989:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623124.712994:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788623124.712997:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.713004:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e373b9000/0xef842f43731d786a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7871 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.713006:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.713011:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788623124.713013:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623124.713015:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788623124.713017:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623124.713017:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.713023:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.119@tcp lock: ffff997e2f0db600/0xef842f43731d781d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xef842f43731d7824 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.713038:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623124.713039:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623124.713041:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3279:1875506866788480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788623124.713041:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623124.713047:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623124.713055:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ef52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866788608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623124.713089:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623124.713096:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866788736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788623124.713124:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623124.714479:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866788096:0@lo:104: 00000100:00100000:3.0:1788623124.714498:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866788224:0@lo:104: 00000100:00100000:3.0:1788623124.714508:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866788352:0@lo:104: 00000100:00100000:3.0:1788623124.715643:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623124.715906:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866787840:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623124.715919:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875506866787968:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623124.715966:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623124.716188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623124.716379:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788608 00000100:00100000:1.0:1788623124.716399:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788608 00010000:00010000:1.0:1788623124.716461:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d786a expref: 19 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623124.716489:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788736 00000100:00100000:1.0:1788623124.716493:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788736 00010000:00010000:1.0:1788623124.716506:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d781d expref: 20 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623124.716517:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409216 00000100:00100000:1.0:1788623124.716520:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409216 00010000:00010000:1.0:1788623124.716535:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 13 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623124.716550:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788623124.716570:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+20:3280:x1875506866788608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788623124.716588:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623124.716594:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d786a expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716605:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d786a expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716627:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e372fa600/0xef842f43731d7871 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d786a expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716655:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623124.716736:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3280:x1875506866788608:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623124.716775:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788623124.716796:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788623124.716802:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:3281:x1875506866788736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788623124.716811:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623124.716815:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d781d expref: 18 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716823:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d781d expref: 18 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716834:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e372fae00/0xef842f43731d7824 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d781d expref: 18 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716843:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623124.716872:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:3281:x1875506866788736:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623124.716878:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788623124.716892:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788623124.716900:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2348:x1875506858409216:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623124.716909:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623124.716914:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 13 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716924:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 13 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716935:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13734600/0xef842f43731d7b03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ebd9 expref: 13 pid: 14318 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.716953:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623124.717002:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:2348:x1875506858409216:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 102us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623124.717009:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788623124.717051:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866788736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623124.717258:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623124.717343:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3280:1875506866788608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788623124.717844:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788480 00000100:00100000:1.0:1788623124.717852:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788480 00010000:00010000:1.0:1788623124.717880:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d799e expref: 17 pid: 14320 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623124.717940:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788623124.717949:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:3279:x1875506866788480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788623124.717959:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623124.717964:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xef842f43731d799e expref: 17 pid: 14320 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.717973:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xef842f43731d799e expref: 17 pid: 14320 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.717989:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b9200/0xef842f43731d79a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xef842f43731d799e expref: 17 pid: 14320 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623124.718002:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623124.718051:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:3279:x1875506866788480:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623124.718057:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788623124.718982:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ef50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3279:1875506866788480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788623124.719953:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409344 00000100:00100000:0.0:1788623124.719979:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409344 00010000:00010000:0.0:1788623124.720021:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623124.720053:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:0.0:1788623124.720064:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:2348:x1875506858409344:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623124.720080:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623124.720088:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720103:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720125:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e373b8200/0xef842f43731d7acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eb77 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720465:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720476:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720498:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720507:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720515:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720534:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720541:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623124.720547:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720619:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720711:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623124.720727:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623124.720836:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:2348:x1875506858409344:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 772us (4646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623124.720845:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00010000:00010000:3.0:1788623124.721294:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.721306:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623124.721313:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff997e13735000/0xef842f43731d7b2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623125.557788:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866788864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788623125.557897:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623125.558159:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788864 00000100:00100000:2.0:1788623125.558173:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788864 00000100:00100000:2.0:1788623125.558265:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788623125.558277:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866788864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788623125.558332:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623125.558395:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875506866788864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623125.558402:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788623125.558480:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875506866788864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788623125.558607:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788623125.675966:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788623126.064843:0:14323:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788623126.064854:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e2fd16800 from 10 10000000:01000000:0.0:1788623126.064861:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788623126.064923:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.064938:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.064968:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623126.065192:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866788992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.065290:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623126.066190:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788623126.068270:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866788992 00000100:00100000:3.0:1788623126.069500:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866788992 00000100:00100000:3.0:1788623126.069588:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788623126.069601:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+16:14323:x1875506866788992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788623126.069624:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623126.070390:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735000/0xef842f43731d7b3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7b34 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.070450:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735000/0xef842f43731d7b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7b34 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.070467:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735000/0xef842f43731d7b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7b34 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.070479:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735000, rc 0) 00000100:00100000:3.0:1788623126.070594:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:14323:x1875506866788992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 996us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.070604:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788623126.070970:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866788992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623126.071012:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b3b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.071024:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7b3b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623126.071119:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.071165:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623126.071211:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623126.071234:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789120 00000100:00100000:0.0:1788623126.071241:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789120 00000100:00100000:0.0:1788623126.071427:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788623126.071439:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:14323:x1875506866789120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.071780:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:14323:x1875506866789120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623126.071788:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788623126.071928:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.071967:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.072017:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623126.072036:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789248 00000100:00100000:0.0:1788623126.072039:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788623126.072045:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789248 00000100:00100000:3.0:1788623126.072096:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788623126.072123:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:14323:x1875506866789248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.072739:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:14323:x1875506866789248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 619us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.072779:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788623126.072848:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788623126.077796:0:16497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788623126.077887:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788623126.077914:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788623126.077929:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b3b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.077943:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b8200/0xef842f43731d7b34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b3b expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788623126.077957:0:14323:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788623126.077960:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e3ccba000 from 10 10000000:01000000:3.0:1788623126.077964:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788623126.078095:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.078105:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.078119:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623126.078155:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.078245:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623126.078312:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788623126.078343:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789376 00000100:00100000:3.0:1788623126.078352:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789376 00000100:00100000:3.0:1788623126.078406:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788623126.078429:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+17:14323:x1875506866789376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788623126.078446:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623126.078462:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e13735800/0xef842f43731d7b49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7b42 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.078493:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e13735800/0xef842f43731d7b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7b42 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.078505:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e13735800/0xef842f43731d7b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7b42 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.078516:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13735800, rc 0) 00000100:00100000:3.0:1788623126.078563:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866789376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.078570:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788623126.078628:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788623126.078645:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b49 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623126.078656:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7b49 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623126.078713:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.078764:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623126.078793:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e1034ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788623126.078809:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789504 00000100:00100000:3.0:1788623126.078813:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789504 00000100:00100000:3.0:1788623126.078841:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788623126.078848:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866789504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.080662:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866789504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1803us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.080676:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788623126.083894:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788623126.084001:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788623126.084125:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623126.084180:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623126.084227:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789632 00000100:00100000:3.0:1788623126.084238:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789632 00000100:00100000:3.0:1788623126.084461:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788623126.084474:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866789632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.084767:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866789632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.084776:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788623126.085612:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788623126.088723:0:16499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788623126.089214:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788623126.089248:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788623126.089263:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b49 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.089277:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e13734000/0xef842f43731d7b42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b49 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788623126.089302:0:14323:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788623126.089306:0:14323:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff997e36e26000 from 10 10000000:01000000:0.0:1788623126.089310:0:14323:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788623126.089363:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.089372:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.089385:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623126.089433:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.089530:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623126.089598:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623126.090422:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789760 00000100:00100000:2.0:1788623126.090436:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789760 00000100:00100000:2.0:1788623126.090495:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788623126.090506:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+18:14323:x1875506866789760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788623126.090524:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623126.090547:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e372fba00/0xef842f43731d7b57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef842f43731d7b50 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623126.090583:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e372fba00/0xef842f43731d7b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xef842f43731d7b50 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623126.090596:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e372fba00/0xef842f43731d7b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xef842f43731d7b50 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623126.090608:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fba00, rc 0) 00000100:00100000:2.0:1788623126.090678:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866789760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623126.090685:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788623126.091140:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623126.091164:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b57 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.091186:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xef842f43731d7b57 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623126.091266:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.091382:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623126.091433:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788623126.091985:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866789888 00000100:00100000:2.0:1788623126.092057:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866789888 00000100:00100000:2.0:1788623126.092112:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788623126.092121:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866789888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788623126.092696:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866789888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 573us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623126.092706:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788623126.093950:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866789888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.094031:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866790016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.094113:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623126.094157:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e10275f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788623126.094642:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790016 00000100:00100000:3.0:1788623126.094651:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790016 00000100:00100000:3.0:1788623126.094719:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788623126.094731:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866790016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.095055:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:14323:x1875506866790016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.095064:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788623126.095128:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd2d9f5a-a1d8-466a-ac20-a19462995af0:14323:1875506866790016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788623126.097451:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788623126.099440:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788623126.099493:0:14323:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788623126.099511:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b57 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.099527:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.119@tcp lock: ffff997e373b9200/0xef842f43731d7b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xef842f43731d7b57 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623126.297776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623126.297904:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409472 00000100:00100000:0.0:1788623126.297920:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409472 00000100:00100000:0.0:1788623126.298001:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 114 00000100:00100000:0.0:1788623126.298013:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+11:13750:x1875506858409472:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623126.298040:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623126.298078:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9000/0xef842f43731d7b5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec0a expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.298131:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9000/0xef842f43731d7b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec0a expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.298145:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9000/0xef842f43731d7b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec0a expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.298156:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9000, rc 0) 00000100:00100000:0.0:1788623126.298232:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13750:x1875506858409472:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 221us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623126.298239:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 114 00000100:00100000:0.0:1788623126.303727:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623126.303997:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409600 00000100:00100000:3.0:1788623126.304012:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409600 00000100:00100000:3.0:1788623126.304089:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 115 00000100:00100000:3.0:1788623126.304102:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13750:x1875506858409600:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.304556:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13750:x1875506858409600:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 456us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.304565:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 115 00000100:00100000:1.0:1788623126.311009:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623126.312925:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409728 00000100:00100000:3.0:1788623126.312945:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409728 00000100:00100000:3.0:1788623126.313028:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 116 00000100:00100000:3.0:1788623126.313042:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13750:x1875506858409728:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.313392:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13750:x1875506858409728:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 353us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.313402:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 116 00000100:00100000:1.0:1788623126.334910:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623126.336930:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409856 00000100:00100000:0.0:1788623126.336950:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409856 00000100:00100000:0.0:1788623126.337034:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:0.0:1788623126.337048:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+12:13750:x1875506858409856:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788623126.337078:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623126.337103:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff997e373b9c00/0xef842f43731d7b65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec11 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.337156:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff997e373b9c00/0xef842f43731d7b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec11 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.337171:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff997e373b9c00/0xef842f43731d7b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec11 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623126.337183:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b9c00, rc 0) 00000100:00100000:0.0:1788623126.337296:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13750:x1875506858409856:12345-192.168.204.19@tcp:101:ll_cfg_requeue.0 Request processed in 251us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623126.337303:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 117 00000100:00100000:1.0:1788623126.346023:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623126.346107:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858409984 00000100:00100000:0.0:1788623126.346122:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858409984 00000100:00100000:0.0:1788623126.346192:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:0.0:1788623126.346203:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13750:x1875506858409984:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788623126.346588:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13750:x1875506858409984:12345-192.168.204.19@tcp:501:ll_cfg_requeue.0 Request processed in 386us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623126.346598:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 118 00000100:00100000:2.0:1788623126.349632:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623126.349726:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410112 00000100:00100000:3.0:1788623126.349778:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410112 00000100:00100000:3.0:1788623126.349837:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 119 00000100:00100000:3.0:1788623126.349848:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13750:x1875506858410112:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788623126.350135:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:13750:x1875506858410112:12345-192.168.204.19@tcp:503:ll_cfg_requeue.0 Request processed in 287us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623126.350144:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 119 00010000:00010000:2.0:1788623126.700300:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788623127.085978:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788623127.092663:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866790144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788623127.092796:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623127.093035:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790144 00000100:00100000:2.0:1788623127.093047:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790144 00000100:00100000:2.0:1788623127.093129:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788623127.093141:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866790144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788623127.093185:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788623127.093237:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866790144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623127.093244:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788623127.093266:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788623127.093306:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866790144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623127.093562:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866790400:0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.093606:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623127.093635:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788623127.093641:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866790272:0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.093687:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623127.093716:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866790784:0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.093778:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623127.093812:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790400 00000100:00100000:3.0:1788623127.093818:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790400 00000100:00100000:3.0:1788623127.093862:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788623127.093871:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866790400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623127.095317:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790784 00000100:00100000:2.0:1788623127.095332:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790784 00000100:00100000:2.0:1788623127.095410:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788623127.095423:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.095516:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875506866790400:12345-0@lo:400:kworker.0 Request processed in 1646us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623127.095526:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788623127.095562:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788623127.095567:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788623127.095607:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875506866790400:0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.095647:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790272 00000100:00100000:3.0:1788623127.095652:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790272 00000100:00100000:3.0:1788623127.095694:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788623127.095702:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3281:x1875506866790272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623127.096808:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866790784:12345-0@lo:400:kworker.0 Request processed in 1381us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623127.096821:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788623127.097269:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866790528:0@lo:400:kworker.0 00000100:00100000:2.0:1788623127.097416:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623127.097595:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788623127.097607:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e3978c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866790656:0@lo:400:kworker.0 00000100:00100000:2.0:1788623127.097713:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623127.097802:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790528 00000100:00100000:2.0:1788623127.097810:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790528 00000100:00100000:2.0:1788623127.098218:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866790656 00000100:00100000:2.0:1788623127.098223:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866790656 00000100:00100000:0.0:1788623127.098285:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788623127.098306:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866790528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788623127.098550:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875506866790528:12345-0@lo:400:kworker.0 Request processed in 251us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623127.098557:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788623127.098572:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788623127.098578:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866790656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623127.098841:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875506866790656:12345-0@lo:400:kworker.0 Request processed in 271us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623127.098849:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788623127.099560:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3281:x1875506866790272:12345-0@lo:400:kworker.0 Request processed in 3852us (5865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623127.099585:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875506866790656:0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.099588:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788623127.099613:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875506866790528:0@lo:400:kworker.0 00000100:00080000:3.0:1788623127.100373:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788623127.100422:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3281:1875506866790272:0@lo:400:kworker.0 00000100:00100000:3.0:1788623127.100478:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e3978d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866790784:0@lo:400:kworker.0 00010000:00010000:0.0:1788623127.725200:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623128.287132:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.287255:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410240 00000100:00100000:0.0:1788623128.287266:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410240 00000100:00100000:0.0:1788623128.287329:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 121 00000100:00100000:0.0:1788623128.287340:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2350:x1875506858410240:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623128.287433:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2350:x1875506858410240:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.287441:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 121 00000100:00100000:1.0:1788623128.290664:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.290721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.290771:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.290805:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.290828:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623128.290868:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410624 00000100:00100000:1.0:1788623128.290869:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623128.290892:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410624 00000100:00100000:3.0:1788623128.290982:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410880 00000100:00100000:3.0:1788623128.290985:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410880 00000100:00100000:3.0:1788623128.291004:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410496 00000100:00100000:3.0:1788623128.291007:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410496 00000100:00100000:3.0:1788623128.291054:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858411008 00000100:00100000:3.0:1788623128.291058:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858411008 00000100:00100000:3.0:1788623128.291093:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:3.0:1788623128.291105:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858410624:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623128.291213:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858410624:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 110us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623128.291222:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:3.0:1788623128.291246:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:3.0:1788623128.291252:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2351:x1875506858410880:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623128.291278:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2351:x1875506858410880:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623128.291285:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:3.0:1788623128.291296:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:3.0:1788623128.291302:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858410496:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623128.291326:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858410496:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623128.291333:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:3.0:1788623128.291345:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:3.0:1788623128.291351:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2351:x1875506858411008:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623128.291391:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2351:x1875506858411008:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 39us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623128.291397:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00080000:3.0:1788623128.291420:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788623128.291425:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788623128.292531:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410368 00000100:00100000:0.0:1788623128.292546:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410368 00000100:00100000:0.0:1788623128.292637:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858410752 00000100:00100000:0.0:1788623128.292655:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858410752 00000100:00100000:0.0:1788623128.292698:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:0.0:1788623128.292708:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:2350:x1875506858410368:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623128.292811:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:2350:x1875506858410368:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 104us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.292819:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:0.0:1788623128.292837:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:0.0:1788623128.292844:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2351:x1875506858410752:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:0.0:1788623128.292869:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2351:x1875506858410752:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 26us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.292875:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00080000:3.0:1788623128.296383:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623128.326579:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.327819:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858411136 00000100:00100000:0.0:1788623128.327834:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858411136 00000100:00100000:0.0:1788623128.328029:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:0.0:1788623128.328043:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+6:14409:x1875506858411136:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788623128.328066:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.328089:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d7b6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec18 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.328164:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.328180:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.328195:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.328360:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.328378:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.328386:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329188:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329203:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329326:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.329359:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788623128.329362:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623128.329413:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329424:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329430:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329437:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329454:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.329459:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329467:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329480:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:0.0:1788623128.329483:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.329488:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329493:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9a00/0xef842f43731d7b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329507:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329512:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329518:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329523:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e373b9400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.329526:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329532:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329550:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff997e11851d00) 00010000:00010000:0.0:1788623128.329569:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.329573:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.329580:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b9400/0xef842f43731d7b7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.333779:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8400/0xef842f43731d7b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec18 expref: 8 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.333799:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8c00/0xef842f43731d7b81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec18 expref: 7 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.333808:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff997e11851100) 00010000:00010000:0.0:1788623128.333811:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788623128.333815:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e373b8c00, rc 0) 00000100:00100000:0.0:1788623128.333911:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+7:14409:x1875506858411136:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 5870us (7342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.333920:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 15 00000100:00100000:2.0:1788623128.342693:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.343064:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858411392 00000100:00100000:0.0:1788623128.343077:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858411392 00000100:00100000:0.0:1788623128.343148:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:0.0:1788623128.343161:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+7:14409:x1875506858411392:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788623128.343185:0:15742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.343242:0:15742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7000/0xef842f43731d7b88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec1f expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.343354:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.343387:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.343402:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.343442:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.343451:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.343459:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.344566:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6000/0xef842f43731d7b9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.344595:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6000/0xef842f43731d7b9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.344605:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6000/0xef842f43731d7b9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.344617:0:15742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788623128.345295:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345316:0:15742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345322:0:15742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345327:0:15742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.345332:0:15742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345340:0:15742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345353:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff997e11851100) 00010000:00010000:0.0:1788623128.345355:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.345360:0:15742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345376:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7b8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345389:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345395:0:15742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345400:0:15742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345405:0:15742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.345412:0:15742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345418:0:15742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345425:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff997e11851b00) 00010000:00010000:0.0:1788623128.345427:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.345430:0:15742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.345435:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7b96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.346433:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7000/0xef842f43731d7b88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec1f expref: 10 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.346455:0:15742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6000/0xef842f43731d7b9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec1f expref: 9 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.346463:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11851d00) 00010000:00010000:1.0:1788623128.346465:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623128.346468:0:15742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6000, rc 0) 00000100:00100000:1.0:1788623128.346544:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+9:14409:x1875506858411392:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 3386us (3860us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788623128.346553:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:2.0:1788623128.353778:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.353912:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858411520 00000100:00100000:0.0:1788623128.353928:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858411520 00000100:00100000:0.0:1788623128.354010:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788623128.354022:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+9:14409:x1875506858411520:12345-192.168.204.19@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788623128.354150:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+9:14409:x1875506858411520:12345-192.168.204.19@tcp:59:lhsmtool_posix.0 Request processed in 130us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.354159:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788623128.385541:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.385673:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858411648 00000100:00100000:2.0:1788623128.385687:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858411648 00000100:00100000:2.0:1788623128.385827:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:2.0:1788623128.385840:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+9:14415:x1875506858411648:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623128.385871:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623128.385906:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec26 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386183:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386203:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386218:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386261:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386268:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386276:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386536:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386546:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386553:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386560:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fb000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623128.386565:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386575:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386590:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:2.0:1788623128.386593:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623128.386598:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386606:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386629:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386636:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386642:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386647:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fa000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623128.386650:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386657:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386665:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff997e07097100) 00010000:00010000:2.0:1788623128.386667:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623128.386670:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386676:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386717:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec26 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.386728:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:2.0:1788623128.386730:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623128.387692:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec26 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.387716:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fae00, rc 0) 00000100:00100000:2.0:1788623128.388736:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+9:14415:x1875506858411648:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 2889us (3204us total) trans 0 rc 301/301 00000100:00100000:2.0:1788623128.388784:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:2.0:1788623128.394602:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623128.395295:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858411776 00000100:00100000:3.0:1788623128.395309:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858411776 00000100:00100000:3.0:1788623128.395391:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:3.0:1788623128.395404:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:da67b507-6848-4965-872f-6899e670b6fc+9:14415:x1875506858411776:12345-192.168.204.19@tcp:700:lfs.0 00000100:00100000:3.0:1788623128.395530:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:da67b507-6848-4965-872f-6899e670b6fc+9:14415:x1875506858411776:12345-192.168.204.19@tcp:700:lfs.0 Request processed in 128us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623128.395539:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:1.0:1788623128.399740:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.400458:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858412032 00000100:00100000:2.0:1788623128.400471:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858412032 00000100:00100000:2.0:1788623128.400659:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:2.0:1788623128.400672:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+9:14415:x1875506858412032:12345-192.168.204.19@tcp:36:lfs.0 00010000:00010000:2.0:1788623128.400776:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623128.400823:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7aee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eba1 expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.400857:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:2.0:1788623128.400865:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788623128.401202:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.401220:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 5 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.401231:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.401281:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 5 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.401313:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 5 pid: 14328 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623128.401332:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1875506866790912:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623128.401482:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e065710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623128.405186:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2eecb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1875506866790912:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623128.405228:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623128.405616:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.407345:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858412160 00000100:00100000:0.0:1788623128.407375:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858412160 00010000:00010000:0.0:1788623128.407450:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 6 pid: 14328 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623128.407501:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:0.0:1788623128.407523:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2349:x1875506858412160:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623128.407567:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623128.407576:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 6 pid: 14328 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.407594:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 6 pid: 14328 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.407623:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e373b8e00/0xef842f43731d7b26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec03 expref: 6 pid: 14328 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.407645:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:0.0:1788623128.407651:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.407663:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.407671:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.407944:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623128.408085:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2349:x1875506858412160:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 572us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.408095:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00010000:00010000:3.0:1788623128.410028:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.410259:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.410307:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.410323:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.410339:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788623128.413677:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788623128.413703:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.413716:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.413726:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.414236:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fae00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623128.414245:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.414257:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.414280:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e11991500) 00010000:00010000:3.0:1788623128.414283:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623128.414290:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.414296:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7bc0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788623128.414328:0:14327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b65b597 reply state 000000001ddfbeab transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623128.414339:0:14327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788623128.414625:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ef52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+10:14415:x1875506858412032:12345-192.168.204.19@tcp:36:lfs.0 Request processed in 13949us (14893us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788623128.414636:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00010000:00010000:3.0:1788623128.420343:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.420381:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.420391:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.420424:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13734400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623128.420430:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.420440:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.420478:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff997e028f9700) 00010000:00010000:3.0:1788623128.420481:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623128.420488:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.420495:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7bc7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623128.502129:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.502381:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858412288 00000100:00100000:2.0:1788623128.502396:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858412288 00000100:00100000:2.0:1788623128.502565:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:2.0:1788623128.502579:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+9:14423:x1875506858412288:12345-192.168.204.19@tcp:101:lctl.0 00010000:00010000:2.0:1788623128.502710:0:15742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623128.502776:0:15742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec2d expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.502923:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.502940:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.502955:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623128.503002:0:15742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788623128.503024:0:15742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788623128.503137:0:15742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.503169:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec2d expref: 11 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.503194:0:15742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fb000/0xef842f43731d7bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec2d expref: 10 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.503204:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:2.0:1788623128.503207:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788623128.503212:0:15742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fb000, rc 0) 00000100:00100000:2.0:1788623128.503353:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+10:14423:x1875506858412288:12345-192.168.204.19@tcp:101:lctl.0 Request processed in 776us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623128.503361:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:1.0:1788623128.523017:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.523175:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858412416 00000100:00100000:0.0:1788623128.523192:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858412416 00000100:00100000:0.0:1788623128.523270:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:0.0:1788623128.523284:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:14424:x1875506858412416:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623128.523336:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.523375:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7bdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec34 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.523460:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7be3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.523479:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.523494:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.523542:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788623128.523547:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623128.523572:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.523601:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7bdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec34 expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.523623:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6400/0xef842f43731d7be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec34 expref: 6 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.523633:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:0.0:1788623128.523637:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788623128.523641:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6400, rc 0) 00000100:00100000:0.0:1788623128.523725:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:14424:x1875506858412416:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 444us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.523733:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788623128.527021:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.527118:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858412544 00000100:00100000:0.0:1788623128.527131:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858412544 00000100:00100000:0.0:1788623128.527209:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:0.0:1788623128.527221:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:14424:x1875506858412544:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623128.527248:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.527277:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7e00/0xef842f43731d7bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec3b expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527376:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527393:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527407:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527424:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527431:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527437:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527555:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7800/0xef842f43731d7bff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527564:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7800/0xef842f43731d7bff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527596:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7800/0xef842f43731d7bff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.527635:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788623128.527639:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623128.527662:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7800/0xef842f43731d7bff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527676:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527683:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527689:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527695:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.527700:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527710:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527723:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:0.0:1788623128.527727:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.527732:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527738:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527902:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527910:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527916:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527921:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e7600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.527925:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527931:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527940:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff997e11851b00) 00010000:00010000:0.0:1788623128.527943:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.527947:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527953:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7bf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.527991:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7e00/0xef842f43731d7bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec3b expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.528006:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7800/0xef842f43731d7bff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec3b expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.528025:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623128.528028:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788623128.528031:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e7800, rc 0) 00000100:00100000:0.0:1788623128.528106:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:14424:x1875506858412544:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 886us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.528114:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:1.0:1788623128.534477:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.534738:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858412800 00000100:00100000:0.0:1788623128.534767:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858412800 00000100:00100000:0.0:1788623128.534853:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:0.0:1788623128.534866:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+7:14424:x1875506858412800:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623128.534896:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.534925:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7e00/0xef842f43731d7c06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec42 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.535050:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788623128.535228:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7e00/0xef842f43731d7c06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec42 expref: 9 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.535245:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:0.0:1788623128.535249:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788623128.535256:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7e00/0xef842f43731d7c06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec42 expref: 9 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.535272:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e7e00, rc 0) 00000100:00100000:0.0:1788623128.535342:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+8:14424:x1875506858412800:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 478us (882us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788623128.535373:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 23 00000100:00100000:1.0:1788623128.539020:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.539664:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858413056 00000100:00100000:0.0:1788623128.539679:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858413056 00000100:00100000:0.0:1788623128.540197:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:0.0:1788623128.540216:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+8:14424:x1875506858413056:12345-192.168.204.19@tcp:36:lfs.0 00010000:00010000:0.0:1788623128.540299:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623128.540334:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7800/0xef842f43731d7bff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec3b expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.540358:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623128.540383:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788623128.540415:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.540432:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.540445:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788623128.540789:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025680058 reply state 00000000767d5d8f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623128.540989:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788623128.541000:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788623128.541254:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+9:14424:x1875506858413056:12345-192.168.204.19@tcp:36:lfs.0 Request processed in 1041us (2247us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788623128.541263:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 24 00000100:00100000:1.0:1788623128.544538:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623128.544637:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858413312 00000100:00100000:3.0:1788623128.544652:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858413312 00000100:00100000:3.0:1788623128.544733:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:3.0:1788623128.544777:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3a315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+9:14424:x1875506858413312:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:3.0:1788623128.545120:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3a315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+10:14424:x1875506858413312:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 375us (597us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788623128.545131:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:1.0:1788623128.548408:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.548496:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858413568 00000100:00100000:0.0:1788623128.548509:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858413568 00000100:00100000:0.0:1788623128.548586:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:0.0:1788623128.548606:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+10:14424:x1875506858413568:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623128.548642:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.548671:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec49 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.548803:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.548821:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.548834:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.548853:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.548861:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.548868:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.549018:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788623128.549142:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549152:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549180:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549187:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.549193:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549203:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549218:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:0.0:1788623128.549222:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.549228:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549235:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549251:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549259:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549266:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549273:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.549276:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549294:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549303:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff997e11851e00) 00010000:00010000:0.0:1788623128.549306:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.549310:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549316:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549376:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec49 expref: 12 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549389:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:0.0:1788623128.549391:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788623128.549396:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec49 expref: 12 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.549406:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6800, rc 0) 00000100:00100000:0.0:1788623128.549491:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+11:14424:x1875506858413568:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 894us (1096us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788623128.549499:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 25 00000100:00100000:0.0:1788623128.552477:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.552553:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858413696 00000100:00100000:1.0:1788623128.552567:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858413696 00000100:00100000:1.0:1788623128.552652:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:1.0:1788623128.552663:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7913ea46-1c5d-4f6e-a105-ceba586b48a3+11:14424:x1875506858413696:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:1.0:1788623128.552696:0:15742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623128.552721:0:15742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7c37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec50 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.552862:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.552878:0:15742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.552889:0:15742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.552912:0:15742:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.552926:0:15742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553415:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553427:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553434:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553441:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e7600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623128.553446:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553455:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553493:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851b00) 00010000:00010000:2.0:1788623128.553496:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788623128.553500:0:3264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553509:0:3264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553517:0:3264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553600:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.553608:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7600/0xef842f43731d7c14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.553698:0:15742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.553707:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623128.553934:0:15742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788623128.553939:0:15742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623128.553973:0:15742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.554020:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7c37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 12 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.554040:0:15742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 11 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623128.554049:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851b00) 00010000:00010000:1.0:1788623128.554052:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788623128.554055:0:15742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dbe00, rc 0) 00000100:00100000:1.0:1788623128.554256:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7913ea46-1c5d-4f6e-a105-ceba586b48a3+11:14424:x1875506858413696:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1593us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623128.554266:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 26 00000100:00100000:1.0:1788623128.557720:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623128.557951:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858413824 00000100:00100000:3.0:1788623128.557964:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858413824 00000100:00100000:3.0:1788623128.558056:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:3.0:1788623128.558077:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+11:14424:x1875506858413824:12345-192.168.204.19@tcp:37:lfs.0 00000100:00100000:3.0:1788623128.563323:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+11:14424:x1875506858413824:12345-192.168.204.19@tcp:37:lfs.0 Request processed in 5240us (5602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623128.563353:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:0.0:1788623128.567115:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.567322:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858414080 00000100:00100000:1.0:1788623128.567336:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858414080 00000100:00100000:1.0:1788623128.567420:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788623128.567434:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e397eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+11:14424:x1875506858414080:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788623128.567810:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e397eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7913ea46-1c5d-4f6e-a105-ceba586b48a3+12:14424:x1875506858414080:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 378us (709us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788623128.567820:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788623128.637445:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.637802:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858414208 00000100:00100000:0.0:1788623128.637815:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858414208 00000100:00100000:0.0:1788623128.637898:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:0.0:1788623128.637918:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+10:14430:x1875506858414208:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788623128.637948:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.637974:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec57 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638163:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638184:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638199:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638219:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638226:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638233:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638349:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7a00/0xef842f43731d7c5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638357:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7a00/0xef842f43731d7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638375:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7a00/0xef842f43731d7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.638420:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788623128.638424:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788623128.638467:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7a00/0xef842f43731d7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638481:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638488:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638496:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638503:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.638508:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638517:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638603:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:0.0:1788623128.638607:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.638613:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638621:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638635:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638653:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638720:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638726:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.638730:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638736:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638842:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff997e11851e00) 00010000:00010000:0.0:1788623128.638844:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.638848:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638855:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638895:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec57 expref: 12 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638909:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7a00/0xef842f43731d7c5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec57 expref: 11 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.638918:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851b00) 00010000:00010000:0.0:1788623128.638921:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788623128.638929:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e7a00, rc 0) 00000100:00100000:0.0:1788623128.639017:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+11:14430:x1875506858414208:12345-192.168.204.19@tcp:101:bash.0 Request processed in 1101us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.639025:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 27 00000100:00100000:2.0:1788623128.644153:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.644244:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858414464 00000100:00100000:0.0:1788623128.644258:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858414464 00000100:00100000:0.0:1788623128.644334:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 28 00000100:00100000:0.0:1788623128.644346:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2eecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+11:14430:x1875506858414464:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:0.0:1788623128.644382:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.644411:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7c61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec5e expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.644588:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.644605:0:14328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 11 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.644615:0:14328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.644674:0:14328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 11 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.644691:0:14328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 11 pid: 15742 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623128.644708:0:14328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14328:1875506866791040:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623128.644903:0:14328:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788623128.649110:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.649320:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858414592 00000100:00100000:2.0:1788623128.649334:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858414592 00010000:00010000:2.0:1788623128.649401:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 12 pid: 15742 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623128.649454:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788623128.649466:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+12:2349:x1875506858414592:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788623128.649487:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623128.649496:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 12 pid: 15742 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.649547:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 12 pid: 15742 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.649581:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851b00) 00010000:00010000:2.0:1788623128.649587:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.649608:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.649618:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.649643:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623128.649725:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+12:2349:x1875506858414592:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 260us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623128.649734:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00010000:00010000:0.0:1788623128.650517:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7c3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec50 expref: 11 pid: 15742 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623128.650554:0:14328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14328:1875506866791040:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788623128.650582:0:14328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.650602:0:14328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.650610:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.650640:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.650653:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.650671:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.651918:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.651935:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.651947:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.651978:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788623128.652018:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652027:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652035:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652041:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e7200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623128.652047:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652057:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652074:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851b00) 00010000:00010000:0.0:1788623128.652078:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623128.652082:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652089:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7c68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788623128.652102:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006010c76e reply state 000000006d322d36 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623128.652114:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788623128.652163:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7c61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 14 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652191:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 13 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.652199:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623128.652201:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788623128.652204:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6200, rc 0) 00000100:00100000:0.0:1788623128.652300:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2eecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+14:14430:x1875506858414464:12345-192.168.204.19@tcp:101:bash.0 Request processed in 7957us (8163us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788623128.652310:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 28 00010000:00010000:3.0:1788623128.660422:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.660446:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.660456:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.660462:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1788623128.660469:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.660478:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.660502:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff997e11851e00) 00010000:00010000:3.0:1788623128.660506:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788623128.660512:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623128.660518:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6800/0xef842f43731d7c6f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623128.672179:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.672545:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858414720 00000100:00100000:2.0:1788623128.672560:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858414720 00000100:00100000:2.0:1788623128.672643:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:2.0:1788623128.672659:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+13:14430:x1875506858414720:12345-192.168.204.19@tcp:101:bash.0 00010000:00010000:2.0:1788623128.672700:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623128.672731:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7c84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec65 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673019:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673296:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673310:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623128.673375:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788623128.673380:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788623128.673411:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673424:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673460:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7c84 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 15 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673484:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 14 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.673493:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:2.0:1788623128.673497:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623128.673501:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fae00, rc 0) 00000100:00100000:2.0:1788623128.673636:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+14:14430:x1875506858414720:12345-192.168.204.19@tcp:101:bash.0 Request processed in 980us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623128.673645:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 29 00000100:00100000:1.0:1788623128.677540:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.677703:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858414976 00000100:00100000:2.0:1788623128.677719:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858414976 00000100:00100000:2.0:1788623128.681024:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:2.0:1788623128.681304:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da67b507-6848-4965-872f-6899e670b6fc+14:14430:x1875506858414976:12345-192.168.204.19@tcp:35:bash.0 00000100:00100000:2.0:1788623128.682511:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da67b507-6848-4965-872f-6899e670b6fc+15:14430:x1875506858414976:12345-192.168.204.19@tcp:35:bash.0 Request processed in 1213us (4979us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788623128.682532:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00010000:00010000:2.0:1788623128.748027:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788623128.765711:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.766045:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858415232 00000100:00100000:2.0:1788623128.766122:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858415232 00000100:00100000:2.0:1788623128.766202:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:2.0:1788623128.766213:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+15:14440:x1875506858415232:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:2.0:1788623128.766243:0:15742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623128.766272:0:15742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7c92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec6c expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623128.766405:0:15742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788623128.766567:0:15742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7c92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec6c expref: 17 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.766586:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff997e07097100) 00010000:00010000:2.0:1788623128.766590:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623128.766607:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7c92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec6c expref: 17 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.766625:0:15742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fa600, rc 0) 00000100:00100000:2.0:1788623128.766714:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+16:14440:x1875506858415232:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 503us (1076us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788623128.766723:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:3.0:1788623128.770390:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623128.770647:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858415488 00000100:00100000:1.0:1788623128.770671:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858415488 00000100:00100000:1.0:1788623128.771011:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788623128.771027:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+16:14440:x1875506858415488:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:1.0:1788623128.771349:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+17:14440:x1875506858415488:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 326us (975us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788623128.772404:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788623128.834152:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623128.834268:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858415744 00000100:00100000:0.0:1788623128.834282:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858415744 00000100:00100000:0.0:1788623128.834387:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:0.0:1788623128.834401:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+17:14443:x1875506858415744:12345-192.168.204.19@tcp:101:lfs.0 00010000:00010000:0.0:1788623128.834435:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623128.834473:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7ca0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec73 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.835184:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7ca7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.835485:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.835503:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623128.835520:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788623128.836210:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7ca0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec73 expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.836239:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec73 expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.836250:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623128.836254:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623128.836258:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e7200, rc 0) 00000100:00100000:0.0:1788623128.836372:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+19:14443:x1875506858415744:12345-192.168.204.19@tcp:101:lfs.0 Request processed in 1973us (2235us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788623128.836381:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:3.0:1788623128.842689:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623128.842792:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.843171:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858415872 00000100:00100000:2.0:1788623128.843185:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858415872 00000100:00100000:2.0:1788623128.843268:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:2.0:1788623128.843280:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+19:14443:x1875506858415872:12345-192.168.204.19@tcp:54:lfs.0 00010000:00010000:2.0:1788623128.843393:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843415:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843430:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843467:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843476:0:15742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843484:0:15742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843491:0:15742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e372fa600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623128.843497:0:15742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843506:0:15742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843520:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:2.0:1788623128.843524:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788623128.843548:0:15742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623128.843555:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623128.843823:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858416000 00000100:00100000:0.0:1788623128.843830:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858416000 00000100:00100000:0.0:1788623128.843881:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:0.0:1788623128.843891:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+20:2349:x1875506858416000:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623128.843903:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623128.843922:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7200/0xef842f43731d7ca7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec73 expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623128.843934:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623128.843939:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623128.843961:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+19:2349:x1875506858416000:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 73us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623128.843969:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:2.0:1788623128.844474:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+18:14443:x1875506858415872:12345-192.168.204.19@tcp:54:lfs.0 Request processed in 1192us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623128.844482:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 32 00000100:00100000:3.0:1788623128.854227:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623128.857391:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858416256 00000100:00100000:2.0:1788623128.857414:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858416256 00000100:00100000:2.0:1788623128.857604:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:2.0:1788623128.857619:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da67b507-6848-4965-872f-6899e670b6fc+18:14443:x1875506858416256:12345-192.168.204.19@tcp:35:lfs.0 00000100:00100000:2.0:1788623128.858049:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da67b507-6848-4965-872f-6899e670b6fc+19:14443:x1875506858416256:12345-192.168.204.19@tcp:35:lfs.0 Request processed in 432us (3836us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788623128.858059:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00000040:00080000:0.0:1788623129.132972:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788623129.185517:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623129.185641:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858416512 00000100:00100000:2.0:1788623129.185666:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858416512 00000100:00100000:2.0:1788623129.185775:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:2.0:1788623129.185790:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+19:14474:x1875506858416512:12345-192.168.204.19@tcp:101:cat.0 00010000:00010000:2.0:1788623129.185945:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623129.185975:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec7a expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.186123:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7cc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.186142:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.186183:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788623129.186200:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788623129.186413:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa600/0xef842f43731d7cbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec7a expref: 22 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.186438:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec7a expref: 21 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.186449:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:2.0:1788623129.186452:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788623129.186457:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e372fa000, rc 0) 00000100:00100000:2.0:1788623129.186540:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+21:14474:x1875506858416512:12345-192.168.204.19@tcp:101:cat.0 Request processed in 755us (1039us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788623129.186548:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 33 00000100:00100000:3.0:1788623129.191023:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623129.191250:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858416768 00000100:00100000:1.0:1788623129.191265:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858416768 00000100:00100000:1.0:1788623129.191341:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:1.0:1788623129.191364:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+21:14474:x1875506858416768:12345-192.168.204.19@tcp:35:cat.0 00000100:00100000:1.0:1788623129.191874:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+22:14474:x1875506858416768:12345-192.168.204.19@tcp:35:cat.0 Request processed in 520us (862us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788623129.191883:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 8 00000100:00100000:3.0:1788623129.193398:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623129.193638:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858416896 00000100:00100000:1.0:1788623129.193651:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858416896 00000100:00100000:1.0:1788623129.193977:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:1.0:1788623129.193992:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da67b507-6848-4965-872f-6899e670b6fc+22:2349:x1875506858416896:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623129.194012:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623129.194046:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fa000/0xef842f43731d7cc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec7a expref: 22 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623129.194135:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:1.0:1788623129.194143:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623129.194244:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da67b507-6848-4965-872f-6899e670b6fc+21:2349:x1875506858416896:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 255us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623129.196536:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:0.0:1788623129.241117:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623129.241280:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858417152 00000100:00100000:2.0:1788623129.241298:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858417152 00000100:00100000:2.0:1788623129.241390:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:2.0:1788623129.241402:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+21:14480:x1875506858417152:12345-192.168.204.19@tcp:101:dd.0 00010000:00010000:2.0:1788623129.241435:0:15742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788623129.241464:0:15742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d7cd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec81 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.241847:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.241892:0:15742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 22 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.241900:0:15742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 22 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.241908:0:15742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.241964:0:15742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 22 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.241979:0:15742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 22 pid: 14327 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623129.241997:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15742:1875506866791168:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623129.242152:0:15742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 22 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.242162:0:15742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 22 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623129.242172:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15742:1875506866791296:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623129.242199:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e06571e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788623129.245395:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623129.245405:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15742:1875506866791168:192.168.204.19@tcp:104: 00000100:00100000:1.0:1788623129.245420:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15742:1875506866791296:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623129.245434:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00010000:00010000:1.0:1788623129.245457:0:15742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623129.246142:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858417280 00000100:00100000:3.0:1788623129.246154:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858417280 00010000:00010000:3.0:1788623129.246205:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 23 pid: 14327 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623129.246251:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858417408 00000100:00100000:3.0:1788623129.246255:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858417408 00010000:00010000:3.0:1788623129.246270:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 24 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623129.246287:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788623129.246297:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+24:2348:x1875506858417280:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623129.246314:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623129.246323:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 24 pid: 14327 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246339:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 24 pid: 14327 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246377:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e372fae00/0xef842f43731d7c8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec65 expref: 24 pid: 14327 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246400:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:3.0:1788623129.246406:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246416:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246443:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623129.246561:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+23:2348:x1875506858417280:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 263us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623129.246571:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788623129.246639:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 12 00000100:00100000:3.0:1788623129.246833:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+22:2348:x1875506858417408:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788623129.246843:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788623129.246849:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 22 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246860:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 22 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246875:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7c76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec5e expref: 22 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246886:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:3.0:1788623129.246889:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246897:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246906:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.246933:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788623129.246960:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+21:2348:x1875506858417408:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 314us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623129.246967:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 12 00010000:00010000:1.0:1788623129.247073:0:15742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623129.247083:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623129.247107:0:15742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788623129.247340:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fba00/0xef842f43731d7cd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec81 expref: 22 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623129.247369:0:15742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fb400/0xef842f43731d7cd8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec81 expref: 21 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623129.247377:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:1.0:1788623129.247380:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788623129.247382:0:15742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e013fb400, rc 0) 00000100:00100000:1.0:1788623129.247419:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+21:14480:x1875506858417152:12345-192.168.204.19@tcp:101:dd.0 Request processed in 6020us (6313us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788623129.247428:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 34 00000100:00100000:2.0:1788623129.251286:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623129.251392:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858417664 00000100:00100000:0.0:1788623129.251407:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858417664 00000100:00100000:0.0:1788623129.251484:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 35 00000100:00100000:0.0:1788623129.251498:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+21:14480:x1875506858417664:12345-192.168.204.19@tcp:36:dd.0 00010000:00010000:0.0:1788623129.252151:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.252174:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.252188:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788623129.252250:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788623129.252294:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000121a11ca reply state 000000002551e525 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623129.252306:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788623129.252487:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+24:14480:x1875506858417664:12345-192.168.204.19@tcp:36:dd.0 Request processed in 989us (1213us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788623129.252496:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 35 00000020:00080000:0.0:1788623129.252502:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788623129.262697:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.262776:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.262787:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.262795:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623129.262802:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.262812:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.262838:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:2.0:1788623129.262842:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623129.262849:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.262855:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7ce6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623129.263375:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623129.264099:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858417792 00000100:00100000:3.0:1788623129.264116:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858417792 00000100:00100000:3.0:1788623129.264189:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:3.0:1788623129.264202:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+23:14480:x1875506858417792:12345-192.168.204.19@tcp:101:dd.0 00010000:00010000:3.0:1788623129.264233:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788623129.264260:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7ced lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec88 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.264345:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec88 expref: 24 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.264372:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec88 expref: 24 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623129.264398:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:3.0:1788623129.264402:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788623129.264405:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e13734400, rc 0) 00000100:00100000:3.0:1788623129.264546:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+24:14480:x1875506858417792:12345-192.168.204.19@tcp:101:dd.0 Request processed in 347us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623129.264555:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 36 00000100:00100000:0.0:1788623129.287453:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623129.287577:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418048 00000100:00100000:3.0:1788623129.287838:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418048 00000100:00100000:2.0:1788623129.288138:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:2.0:1788623129.288153:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+24:14480:x1875506858418048:12345-192.168.204.19@tcp:103:dd.0 00010000:00010000:2.0:1788623129.288175:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788623129.288210:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e13734400/0xef842f43731d7ced lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec88 expref: 24 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.288237:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:2.0:1788623129.288264:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788623129.288356:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+23:14480:x1875506858418048:12345-192.168.204.19@tcp:103:dd.0 Request processed in 197us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623129.288366:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:0.0:1788623129.290720:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623129.291129:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418176 00000100:00100000:2.0:1788623129.291142:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418176 00000100:00100000:2.0:1788623129.291212:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:2.0:1788623129.291223:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+23:14480:x1875506858418176:12345-192.168.204.19@tcp:58:dd.0 00010000:00010000:2.0:1788623129.291361:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.291382:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623129.291397:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788623129.292973:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788623129.293239:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788623129.293324:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788623129.293574:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+23:14480:x1875506858418176:12345-192.168.204.19@tcp:58:dd.0 Request processed in 2344us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623129.293598:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 37 00000100:00100000:3.0:1788623129.297661:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623129.298335:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418304 00000100:00100000:0.0:1788623129.298359:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418304 00000100:00100000:0.0:1788623129.298474:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 38 00000100:00100000:0.0:1788623129.298486:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+23:14480:x1875506858418304:12345-192.168.204.19@tcp:101:dd.0 00010000:00010000:0.0:1788623129.298534:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623129.298563:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec8f expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.298861:0:14328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.298876:0:14328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 24 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.298902:0:14328:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.298918:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 24 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.298935:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623129.298939:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788623129.298943:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 24 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623129.298951:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6c00, rc 0) 00000100:00100000:0.0:1788623129.299127:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+24:14480:x1875506858418304:12345-192.168.204.19@tcp:101:dd.0 Request processed in 642us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623129.299135:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 38 00010000:00010000:2.0:1788623129.772063:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788623130.156261:0:14358:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788623130.156508:0:14358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788623130.156866:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788623130.156883:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788623130.157086:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14358:1875506866791424:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788623130.157355:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788623130.168231:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.168368:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14358:1875506866791424:192.168.204.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788623130.168389:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418432 00000100:00100000:1.0:1788623130.168400:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418432 00000100:00100000:1.0:1788623130.168496:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:1.0:1788623130.168511:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418432:12345-192.168.204.19@tcp:900:lhsmtool_posix.0 00000100:00080000:0.0:1788623130.171220:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788623130.176643:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418432:12345-192.168.204.19@tcp:900:lhsmtool_posix.0 Request processed in 8044us (8336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.176664:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:3.0:1788623130.180188:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.180392:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418560 00000100:00100000:0.0:1788623130.180475:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418560 00000100:00100000:0.0:1788623130.180559:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:0.0:1788623130.180574:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418560:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788623130.180622:0:14326:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788623130.181091:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418560:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 517us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.181102:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 39 00000100:00100000:2.0:1788623130.184613:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.185388:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418688 00000100:00100000:1.0:1788623130.185479:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418688 00000100:00100000:1.0:1788623130.185647:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:1.0:1788623130.185661:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418688:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788623130.185781:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.185806:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.185824:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194513:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194544:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194582:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194618:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194628:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194636:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623130.194687:0:15742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788623130.194691:0:15742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623130.194706:0:15742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194719:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194725:0:15742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194732:0:15742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194737:0:15742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dbe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623130.194769:0:15742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194777:0:15742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194796:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11851d00) 00010000:00010000:1.0:1788623130.194799:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623130.194804:0:15742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194811:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194829:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194835:0:15742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194841:0:15742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194846:0:15742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dba00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623130.194849:0:15742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194855:0:15742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194862:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff997e11991b00) 00010000:00010000:1.0:1788623130.194864:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623130.194868:0:15742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194874:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194902:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194909:0:15742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194915:0:15742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194920:0:15742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dac00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623130.194923:0:15742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194930:0:15742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194937:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:1.0:1788623130.194940:0:15742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788623130.194943:0:15742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.194950:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623130.195063:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418688:12345-192.168.204.19@tcp:34:lhsmtool_posix.0 Request processed in 9400us (10459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.195073:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 40 00000100:00100000:3.0:1788623130.204586:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.204788:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858418944 00000100:00100000:0.0:1788623130.204799:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858418944 00000100:00100000:0.0:1788623130.204858:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:0.0:1788623130.204869:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+24:14481:x1875506858418944:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788623130.204890:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623130.204910:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec96 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205007:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205023:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205047:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788623130.205071:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788623130.205171:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205179:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205186:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205192:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.205197:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205205:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205219:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623130.205222:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788623130.205228:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205234:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205280:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec96 expref: 26 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205292:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff997e11851d00) 00010000:00010000:0.0:1788623130.205294:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788623130.205305:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec96 expref: 26 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.205317:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6e00, rc 0) 00000100:00100000:0.0:1788623130.205400:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+25:14481:x1875506858418944:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 533us (824us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788623130.205408:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 41 00000100:00100000:3.0:1788623130.209437:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.209595:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858419072 00000100:00100000:0.0:1788623130.209605:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858419072 00000100:00100000:0.0:1788623130.209672:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:0.0:1788623130.209682:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+25:14481:x1875506858419072:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788623130.209718:0:14328:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788623130.209839:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+25:14481:x1875506858419072:12345-192.168.204.19@tcp:53:lhsmtool_posix.0 Request processed in 158us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.209847:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 42 00000100:00100000:3.0:1788623130.215901:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.216696:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858419328 00000100:00100000:0.0:1788623130.216707:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858419328 00000100:00100000:0.0:1788623130.216786:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:0.0:1788623130.216797:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+25:14481:x1875506858419328:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788623130.216819:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623130.216840:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d2c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ec9d expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788623130.217557:0:14327:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788623130.220158:0:14327:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788623130.220376:0:14327:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788623130.221345:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.221381:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.221395:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.221474:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d2c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec9d expref: 28 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.221495:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec9d expref: 27 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.221504:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11851800) 00010000:00010000:0.0:1788623130.221507:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788623130.221511:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6e00, rc 0) 00000100:00100000:0.0:1788623130.222261:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+27:14481:x1875506858419328:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 5459us (6366us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788623130.222273:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 43 00000100:00100000:3.0:1788623130.227072:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.227187:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858419584 00000100:00100000:0.0:1788623130.227201:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858419584 00000100:00100000:0.0:1788623130.227274:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:0.0:1788623130.227285:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+27:14481:x1875506858419584:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788623130.227359:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623130.227390:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec9d expref: 27 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227412:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11851800) 00010000:00010000:0.0:1788623130.227439:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788623130.227469:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227484:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227495:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227536:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227545:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227553:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227641:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227649:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227656:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227663:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.227667:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227675:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227692:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff997e11851b00) 00010000:00010000:0.0:1788623130.227695:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623130.227700:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227706:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d41 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227715:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227721:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227727:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227732:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.227735:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227794:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227802:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x799de068 (ffff997e11851c00) 00010000:00010000:0.0:1788623130.227804:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623130.227807:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.227812:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6600/0xef842f43731d7d48 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x799de068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623130.227915:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+26:14481:x1875506858419584:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 631us (857us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788623130.227923:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 44 00000100:00100000:3.0:1788623130.232608:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.232779:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858419712 00000100:00100000:1.0:1788623130.232793:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858419712 00000100:00100000:1.0:1788623130.232864:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:1.0:1788623130.232890:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+26:14481:x1875506858419712:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623130.232914:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623130.232939:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d4f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120eca4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.232976:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.232990:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.233003:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.233119:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eca4 expref: 28 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.233140:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dba00/0xef842f43731d7d56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120eca4 expref: 27 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.233148:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788623130.233151:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788623130.233155:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dba00, rc 0) 00000100:00100000:1.0:1788623130.233217:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+27:14481:x1875506858419712:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 329us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.233224:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 45 00000100:00100000:3.0:1788623130.236321:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.236582:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858419968 00000100:00100000:0.0:1788623130.236592:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858419968 00000100:00100000:0.0:1788623130.236639:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 46 00000100:00100000:0.0:1788623130.236647:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+27:14481:x1875506858419968:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788623130.236731:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.236766:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.236779:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788623130.237212:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788623130.237224:0:14328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 454192481415ns, next at 455192477865ns, rc = 0 00000004:00010000:0.0:1788623130.237316:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e136341d reply state 00000000877341a8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623130.237326:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788623130.237436:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+29:14481:x1875506858419968:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 787us (1125us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788623130.237445:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 46 00010000:00010000:1.0:1788623130.239776:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.239814:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.239822:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.239828:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1788623130.239834:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.239843:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.239862:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788623130.239865:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788623130.239870:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.239876:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6200/0xef842f43731d7d5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623130.241517:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.242014:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858420096 00000100:00100000:1.0:1788623130.242038:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858420096 00000100:00100000:1.0:1788623130.242097:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:1.0:1788623130.242108:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+28:14481:x1875506858420096:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623130.242135:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623130.242159:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ecab expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.242243:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.242260:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.242283:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788623130.242286:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788623130.242290:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0dac00, rc 0) 00000100:00100000:1.0:1788623130.242369:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+29:14481:x1875506858420096:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 262us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.242376:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 47 00000100:00100000:3.0:1788623130.246890:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623130.247012:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858420224 00000100:00100000:2.0:1788623130.247022:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858420224 00000100:00100000:2.0:1788623130.247090:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:2.0:1788623130.247099:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+5:2351:x1875506858420224:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788623130.247484:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+6:2351:x1875506858420224:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 385us (602us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788623130.247493:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00080000:0.0:1788623130.248058:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788623130.251428:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.251560:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858420480 00000100:00100000:1.0:1788623130.251570:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858420480 00000100:00100000:1.0:1788623130.251682:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:1.0:1788623130.251693:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+29:14481:x1875506858420480:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788623130.251986:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+30:14481:x1875506858420480:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 294us (572us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788623130.251995:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 9 00000100:00100000:2.0:1788623130.257629:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.257732:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858420736 00000100:00100000:0.0:1788623130.257784:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858420736 00000100:00100000:0.0:1788623130.257849:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:0.0:1788623130.257860:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+30:14481:x1875506858420736:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788623130.257980:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+30:14481:x1875506858420736:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 122us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.257989:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 48 00000100:00100000:3.0:1788623130.263977:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.264159:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858420864 00000100:00100000:1.0:1788623130.264169:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858420864 00000100:00100000:1.0:1788623130.264230:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:1.0:1788623130.264242:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+30:14481:x1875506858420864:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788623130.264412:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788623130.264447:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d6b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ecb2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.264521:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d7d72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.264535:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.264548:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788623130.264584:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788623130.264603:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.264629:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d6b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb2 expref: 32 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.264648:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d7d72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb2 expref: 31 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.264657:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788623130.264659:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788623130.264663:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e2f0db800, rc 0) 00000100:00100000:1.0:1788623130.264864:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+31:14481:x1875506858420864:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 623us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.264871:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 49 00000100:00100000:3.0:1788623130.275174:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.275809:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858420992 00000100:00100000:0.0:1788623130.275821:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858420992 00000100:00100000:0.0:1788623130.275893:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:0.0:1788623130.275904:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+6:2349:x1875506858420992:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788623130.275924:0:15012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788623130.275947:0:15012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc19fe51c3120ecb9 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788623130.275976:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c391a, blocks: 0x1 00010000:00010000:0.0:1788623130.275999:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1788623130.276004:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.276015:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 7 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.276037:0:15012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 7 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.276052:0:15012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff997e064e6600, rc 0) 00000100:00100000:0.0:1788623130.276120:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+7:2349:x1875506858420992:12345-192.168.204.19@tcp:101:lhsmtool_posix.0 Request processed in 218us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.276128:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:3.0:1788623130.284659:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.284903:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858421248 00000100:00100000:0.0:1788623130.284915:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858421248 00000100:00100000:0.0:1788623130.284987:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:0.0:1788623130.284998:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+31:14481:x1875506858421248:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788623130.285119:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+31:14481:x1875506858421248:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 123us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.285127:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 50 00000100:00100000:3.0:1788623130.292367:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.292688:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858421376 00000100:00100000:0.0:1788623130.292698:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858421376 00000100:00100000:1.0:1788623130.292964:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 51 00000100:00100000:1.0:1788623130.292979:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+31:14481:x1875506858421376:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788623130.357816:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da67b507-6848-4965-872f-6899e670b6fc+31:14481:x1875506858421376:12345-192.168.204.19@tcp:44:lhsmtool_posix.0 Request processed in 64829us (65448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.357830:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 51 00000001:00080000:3.0:1788623130.359202:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1788623130.359214:0:5831:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788623130.359734:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000001:00080000:3.0:1788623130.359881:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788623130.359899:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1788623130.359910:0:5831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788623130.360293:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866791552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788623130.360380:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623130.360667:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866791552 00000100:00100000:3.0:1788623130.360676:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866791552 00000100:00100000:3.0:1788623130.360814:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788623130.360825:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866791552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788623130.361200:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788623130.361206:0:15011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788623130.361208:0:15011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788623130.361210:0:15011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788623130 -> 1788623130 00002000:00010000:3.0:1788623130.361212:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788623130.361263:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875506866791552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 439us (881us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788623130.361287:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788623130.361723:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff997e2ecbc380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788623130.361731:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866791552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788623130.362925:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.363279:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858421504 00000100:00100000:1.0:1788623130.363291:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858421504 00000100:00100000:1.0:1788623130.363356:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:1.0:1788623130.363366:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+7:2349:x1875506858421504:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788623130.363468:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da67b507-6848-4965-872f-6899e670b6fc+7:2349:x1875506858421504:12345-192.168.204.19@tcp:16:lhsmtool_posix.0 Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.363477:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 16 00000100:00100000:3.0:1788623130.367219:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.367497:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858421760 00000100:00100000:1.0:1788623130.367508:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858421760 00000100:00100000:1.0:1788623130.367584:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00100000:1.0:1788623130.367596:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+14:14481:x1875506858421760:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788623130.367657:0:15742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623130.367686:0:15742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0db800/0xef842f43731d7d72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb2 expref: 14 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.367710:0:15742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788623130.367715:0:15742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788623130.367806:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.367823:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.367852:0:15742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788623130.368079:0:15742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000371ae54e reply state 00000000effee96b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623130.368090:0:15742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788623130.368204:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da67b507-6848-4965-872f-6899e670b6fc+15:14481:x1875506858421760:12345-192.168.204.19@tcp:36:lhsmtool_posix.0 Request processed in 610us (994us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788623130.368212:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 52 00000100:00080000:0.0:1788623130.371241:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788623130.379339:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.379357:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.379365:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.379370:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dbe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1788623130.379376:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.379385:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.379403:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:2.0:1788623130.379406:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788623130.379411:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.379418:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dbe00/0xef842f43731d7d80 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623130.381916:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.382485:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858421888 00000100:00100000:0.0:1788623130.382497:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858421888 00000100:00100000:0.0:1788623130.382571:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:0.0:1788623130.382583:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+7:2348:x1875506858421888:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788623130.382852:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788623130.382856:0:15011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788623129 00002000:00010000:0.0:1788623130.382859:0:15011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788623129 00002000:00010000:0.0:1788623130.382861:0:15011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788623130 -> 1788623129 00002000:00010000:0.0:1788623130.382864:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788623130.382939:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+8:2348:x1875506858421888:12345-192.168.204.19@tcp:2:lhsmtool_posix.0 Request processed in 358us (1037us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788623130.382948:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 17 00000100:00100000:3.0:1788623130.390319:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623130.390487:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858422016 00000100:00100000:2.0:1788623130.390498:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858422016 00000100:00100000:2.0:1788623130.390568:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:2.0:1788623130.390596:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+8:2350:x1875506858422016:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788623130.390643:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390661:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623130.390665:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623130.390672:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390687:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390719:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390727:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390734:0:15013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390777:0:15013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fae00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623130.390783:0:15013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390792:0:15013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390813:0:15013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.390820:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000305a058c/0xef842f43731d7d87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623130.390899:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da67b507-6848-4965-872f-6899e670b6fc+8:2350:x1875506858422016:12345-192.168.204.19@tcp:1:lhsmtool_posix.0 Request processed in 305us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623130.390907:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 18 00000100:00100000:3.0:1788623130.393863:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.393971:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858422272 00000100:00100000:0.0:1788623130.393981:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858422272 00000100:00100000:0.0:1788623130.394074:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 53 00000100:00100000:0.0:1788623130.394088:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+14:14481:x1875506858422272:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788623130.394181:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394200:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394212:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394478:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394490:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 15 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394499:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394535:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 15 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.394548:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 15 pid: 14326 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623130.394561:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1875506866791680:192.168.204.19@tcp:104: 00000100:00100000:0.0:1788623130.394654:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623130.398728:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.398985:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858422400 00000100:00100000:1.0:1788623130.398994:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858422400 00010000:00010000:1.0:1788623130.399049:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 16 pid: 14326 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623130.399092:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 13 00000100:00100000:1.0:1788623130.399104:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da67b507-6848-4965-872f-6899e670b6fc+16:2348:x1875506858422400:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788623130.399122:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788623130.399129:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 16 pid: 14326 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.399144:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 16 pid: 14326 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.399166:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:1.0:1788623130.399172:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.399201:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.399209:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.399230:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788623130.399284:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da67b507-6848-4965-872f-6899e670b6fc+16:2348:x1875506858422400:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 182us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623130.399292:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 13 00010000:00010000:0.0:1788623130.399969:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e2f0dac00/0xef842f43731d7d64 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecab expref: 15 pid: 14326 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623130.400005:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1875506866791680:192.168.204.19@tcp:104: 00010000:00010000:0.0:1788623130.400036:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.400045:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.400050:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788623130.400251:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788623130.400404:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788623130.400450:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788623130.400530:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1875506866791808:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788623130.400708:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623130.400861:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788623130.402008:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866791808 00000100:00100000:2.0:1788623130.402020:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866791808 00000100:00100000:2.0:1788623130.402191:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788623130.402201:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875506866791808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788623130.402342:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875506866791808:12345-0@lo:1000:mdt00_001.0 Request processed in 142us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623130.402350:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788623130.402491:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1875506866791808:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788623130.403278:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788623130.403377:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1875506866791936:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788623130.403429:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788623130.403462:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788623130.403831:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866791936 00000100:00100000:2.0:1788623130.403839:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866791936 00000100:00100000:2.0:1788623130.403885:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788623130.403893:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875506866791936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788623130.404211:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14327:x1875506866791936:12345-0@lo:1000:mdt00_001.0 Request processed in 317us (781us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788623130.404219:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788623130.404297:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1875506866791936:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788623130.404343:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404354:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404367:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404373:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.404377:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404385:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404401:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:0.0:1788623130.404404:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788623130.404409:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404415:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6a00/0xef842f43731d7d95 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404446:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404452:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404457:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404461:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fa200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.404464:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404478:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404486:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623130.404488:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788623130.404495:0:14327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404507:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404516:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.404638:0:14327:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6c00/0xef842f43731d7cfb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ec8f expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623130.404653:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e2ecbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1875506866792064:192.168.204.19@tcp:105: 00000100:00100000:0.0:1788623130.404877:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e063a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788623130.409476:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.409611:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e2ecbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1875506866792064:192.168.204.19@tcp:105: 00010000:00010000:0.0:1788623130.409639:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409649:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fa200/0xef842f43731d7cf4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409682:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409712:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409723:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409733:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409775:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409784:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409790:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e7c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.409794:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409802:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409813:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623130.409816:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788623130.409819:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409824:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e7c00/0xef842f43731d7d9c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409833:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409845:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409850:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409856:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e6e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1788623130.409858:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409863:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409871:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff997e11851500) 00010000:00010000:0.0:1788623130.409873:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788623130.409875:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.409879:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e064e6e00/0xef842f43731d7d8e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623130.410455:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858422528 00000100:00100000:2.0:1788623130.410464:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858422528 00000100:00100000:2.0:1788623130.410521:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:2.0:1788623130.410531:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e397ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da67b507-6848-4965-872f-6899e670b6fc+19:14480:x1875506858422528:12345-192.168.204.19@tcp:49:dd.0 00000040:00080000:3.0:1788623130.410807:0:14358:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788623130.410812:0:14358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788623130.410851:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788623130.410857:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788623130.410975:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da67b507-6848-4965-872f-6899e670b6fc+19:14481:x1875506858422272:12345-192.168.204.19@tcp:57:lhsmtool_posix.0 Request processed in 16888us (17121us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788623130.410985:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 53 00000020:00080000:0.0:1788623130.410990:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788623130.412306:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e397ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da67b507-6848-4965-872f-6899e670b6fc+18:14480:x1875506858422528:12345-192.168.204.19@tcp:49:dd.0 Request processed in 1766us (2828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788623130.412318:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 10 00000100:00100000:0.0:1788623130.418716:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623130.418977:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858422784 00000100:00100000:3.0:1788623130.418990:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858422784 00000100:00100000:3.0:1788623130.419063:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 11 00000100:00100000:3.0:1788623130.419075:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e2ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+18:14481:x1875506858422784:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788623130.425225:0:14329:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788623130.427006:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788623130.427262:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.427282:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.427295:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.427304:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.427310:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.427316:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.427354:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788623130.427565:0:15452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788623130.427573:0:15452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.427599:0:15452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fae00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:0.0:1788623130.427604:0:15452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.427614:0:15452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.427627:0:15452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff997e11991b00) 00010000:00010000:0.0:1788623130.427631:0:15452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788623130.427636:0:15452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.427641:0:15452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff997e013fae00/0xef842f43731d7da3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.427657:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623130.427659:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788623130.427662:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788623130.427922:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e2ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da67b507-6848-4965-872f-6899e670b6fc+20:14481:x1875506858422784:12345-192.168.204.19@tcp:35:lhsmtool_posix.0 Request processed in 8843us (9209us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788623130.427935:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 11 00000020:00080000:2.0:1788623130.427942:0:14329:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788623130.647849:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623130.648047:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858422912 00000100:00100000:2.0:1788623130.648058:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858422912 00000100:00100000:2.0:1788623130.648130:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:2.0:1788623130.648141:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+8:2349:x1875506858422912:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:2.0:1788623130.648177:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.648201:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 8 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.648210:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623130.648214:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623130.648219:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.648256:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 8 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.648270:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 8 pid: 15012 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623130.648284:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15016:1875506866792192:192.168.204.19@tcp:104: 00000100:00100000:2.0:1788623130.648386:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff997e07280540 going to sleep for 11 seconds 00000100:00100000:3.0:1788623130.648832:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623130.648954:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788623130.648963:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788623130.649552:0:15018:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788623130.649571:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423040 00000100:00100000:2.0:1788623130.649579:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423040 00000100:00100000:1.0:1788623130.653205:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:2.0:1788623130.653307:0:15018:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788623130.653346:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423168 00000100:00100000:2.0:1788623130.653358:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423168 00000100:00100000:0.0:1788623130.654972:0:16561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 1 00000100:00100000:0.0:1788623130.654989:0:16561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:da67b507-6848-4965-872f-6899e670b6fc+10:2351:x1875506858423040:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:0.0:1788623130.655034:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.655055:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.655060:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.655065:0:16561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.655076:0:16561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623130.659074:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623130.659205:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423296 00000100:00100000:0.0:1788623130.659215:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423296 00010000:00010000:0.0:1788623130.659256:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 11 pid: 15012 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788623130.659318:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 14 00000100:00100000:0.0:1788623130.659338:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997d0770ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+11:2349:x1875506858423296:12345-192.168.204.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788623130.659364:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788623130.659388:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 11 pid: 15012 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.659404:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 11 pid: 15012 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.659430:0:14312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.659435:0:14312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.659441:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.659450:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.659460:0:14312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.659462:0:14312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788623130.659466:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.659488:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788623130.659522:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788623130.659828:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d0770ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da67b507-6848-4965-872f-6899e670b6fc+11:2349:x1875506858423296:12345-192.168.204.19@tcp:103:ldlm_bl.0 Request processed in 491us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623130.659836:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 14 00010000:00010000:2.0:1788623130.659956:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac0b12eb/0xef842f43731d7d79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.19@tcp remote: 0xc19fe51c3120ecb9 expref: 10 pid: 15012 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623130.659972:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15016:1875506866792192:192.168.204.19@tcp:104: 00010000:00010000:2.0:1788623130.659998:0:15016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.660009:0:15016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623130.660017:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623130.661662:0:16561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623130.661682:0:16561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623130.670491:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788623130.670519:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866792320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788623130.670596:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623130.670912:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866792320 00000100:00100000:3.0:1788623130.670922:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866792320 00000100:00100000:3.0:1788623130.671002:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788623130.671040:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866792320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788623130.671104:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788623130.671158:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866792320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623130.671165:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788623130.671420:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788623130.671479:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866792320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788623130.797230:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788623130.883595:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1788623130.883650:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1788623130.883665:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1788623130.885994:0:15016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788623130.886011:0:15016:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788623129 -> 1788623131 00002000:00010000:1.0:1788623130.886015:0:15016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4099 00010000:00010000:1.0:1788623130.886037:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886055:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886089:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886097:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fb000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623130.886103:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886115:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886147:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886156:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f621074/0xef842f43731d7daa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623130.886308:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+10:2349:x1875506858422912:12345-192.168.204.19@tcp:4:dd.0 Request processed in 238160us (238462us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788623130.886330:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 0 00000100:00100000:1.0:1788623130.886377:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 2 00000100:00100000:1.0:1788623130.886395:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+9:2349:x1875506858423168:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:1.0:1788623130.886440:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886453:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623130.886465:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623130.886473:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.886487:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788623130.963990:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1788623130.966814:0:16561:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1788623130.966827:0:16561:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4099 -> 4103 00010000:00010000:1.0:1788623130.966847:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.966863:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.966873:0:16561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.966882:0:16561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e064e7c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623130.966888:0:16561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.966899:0:16561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.966924:0:16561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623130.966962:0:16561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001033ccb6/0xef842f43731d7db1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623130.967113:0:16561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997d07708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:da67b507-6848-4965-872f-6899e670b6fc+9:2351:x1875506858423040:12345-192.168.204.19@tcp:4:dd.0 Request processed in 312121us (318275us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788623130.967127:0:16561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 1 00002000:00010000:1.0:1788623131.047023:0:15016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1788623131.047055:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.047070:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.047081:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.047089:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0daa00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623131.047095:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.047106:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.047133:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.047168:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7db8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623131.047304:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+7:2349:x1875506858423168:12345-192.168.204.19@tcp:4:dd.0 Request processed in 160909us (394100us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788623131.047327:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 2 00000001:00080000:2.0:1788623131.048517:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:3.0:1788623131.054398:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623131.054439:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623131.054460:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623131.054482:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:3.0:1788623131.054525:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423424 00000100:00100000:3.0:1788623131.054537:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423424 00000100:00100000:3.0:1788623131.054611:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423552 00000100:00100000:3.0:1788623131.054615:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423552 00000100:00100000:3.0:1788623131.054629:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423680 00000100:00100000:3.0:1788623131.054632:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423680 00000100:00100000:3.0:1788623131.054642:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423808 00000100:00100000:3.0:1788623131.054645:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423808 00000100:00100000:3.0:1788623131.054662:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:3.0:1788623131.054674:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+8:2348:x1875506858423424:12345-192.168.204.19@tcp:4:dd.0 00002000:00010000:3.0:1788623131.054764:0:15016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9c391b, atime: 0x6a9c3919, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788623131.054776:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.054800:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1788623131.054805:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623131.054814:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.054857:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623131.055247:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 4 00000100:00100000:1.0:1788623131.055261:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da67b507-6848-4965-872f-6899e670b6fc+9:2348:x1875506858423552:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:1.0:1788623131.055282:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.055292:0:15017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623131.055296:0:15017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623131.055302:0:15017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.055322:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623131.058201:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:0.0:1788623131.058410:0:16561:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788623131.058424:0:16561:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788623131.060501:0:16561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858423936 00000100:00100000:0.0:1788623131.060518:0:16561:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858423936 00000100:00100000:2.0:1788623131.061602:0:16563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:2.0:1788623131.061623:0:16563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da67b507-6848-4965-872f-6899e670b6fc+11:2348:x1875506858423680:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:2.0:1788623131.061678:0:16563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.061702:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623131.061713:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788623131.061723:0:16563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.061767:0:16563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788623131.133286:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1788623131.133833:0:15016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1788623131.133839:0:15016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788623131.133854:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.133867:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134015:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134025:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735c00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623131.134031:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134042:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134069:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134079:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263050af/0xef842f43731d7dbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623131.134450:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+15:2348:x1875506858423424:12345-192.168.204.19@tcp:4:dd.0 Request processed in 79772us (80060us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788623131.134460:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 3 00000100:00100000:1.0:1788623131.134494:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 6 00000100:00100000:1.0:1788623131.134507:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+14:2348:x1875506858423808:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:1.0:1788623131.134544:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134557:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623131.134570:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788623131.134577:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.134590:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788623131.180492:0:16563:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1788623131.180501:0:16563:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788623131.180519:0:16563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180533:0:16563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180542:0:16563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180549:0:16563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e013fa000 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:3.0:1788623131.180554:0:16563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180564:0:16563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180587:0:16563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180594:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496ba277/0xef842f43731d7dcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788623131.180696:0:16563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da67b507-6848-4965-872f-6899e670b6fc+16:2348:x1875506858423680:12345-192.168.204.19@tcp:4:dd.0 Request processed in 119075us (126229us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788623131.180707:0:16563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 5 00000100:00100000:3.0:1788623131.180774:0:16563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 7 00000100:00100000:3.0:1788623131.180787:0:16563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da67b507-6848-4965-872f-6899e670b6fc+15:2348:x1875506858423936:12345-192.168.204.19@tcp:4:dd.0 00010000:00010000:3.0:1788623131.180820:0:16563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180833:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623131.180838:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788623131.180844:0:16563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788623131.180858:0:16563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181549:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181562:0:15017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181569:0:15017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181575:0:15017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0daa00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623131.181579:0:15017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181587:0:15017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181602:0:15017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.181609:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005990ec3d/0xef842f43731d7dc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623131.181663:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da67b507-6848-4965-872f-6899e670b6fc+15:2348:x1875506858423552:12345-192.168.204.19@tcp:4:dd.0 Request processed in 126406us (127221us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788623131.181672:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 4 00000001:00080000:1.0:1788623131.185135:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1788623131.185158:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:3.0:1788623131.270390:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1788623131.271812:0:15016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788623131.271821:0:15016:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788623131 00002000:00010000:1.0:1788623131.271824:0:15016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788623131.271843:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.271856:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.271866:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.271874:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e2f0dac00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:1.0:1788623131.271879:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.271889:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.271910:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788623131.271931:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0700eb7/0xef842f43731d7dd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788623131.272050:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da67b507-6848-4965-872f-6899e670b6fc+9:2348:x1875506858423808:12345-192.168.204.19@tcp:4:dd.0 Request processed in 137543us (217561us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788623131.272061:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 6 00000001:00080000:3.0:1788623131.310789:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:2.0:1788623131.311599:0:16563:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788623131.311622:0:16563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.311636:0:16563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.311644:0:16563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.311651:0:16563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff997e13735a00 already unused, calling callback (ffffffffc15e54f0) 00010000:00010000:2.0:1788623131.311821:0:16563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.311834:0:16563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.311855:0:16563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788623131.311864:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006591db63/0xef842f43731d7ddb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788623131.311993:0:16563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da67b507-6848-4965-872f-6899e670b6fc+5:2348:x1875506858423936:12345-192.168.204.19@tcp:4:dd.0 Request processed in 131204us (253799us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788623131.312004:0:16563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 7 00010000:00010000:2.0:1788623131.820432:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788623132.204699:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788623132.204978:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788623132.205015:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866792832:0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.205093:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623132.205177:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866792576:0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.205207:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623132.205231:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788623132.205237:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866792704:0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.205277:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623132.205341:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866792576 00000100:00100000:3.0:1788623132.205349:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866792576 00000100:00100000:3.0:1788623132.205398:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866792704 00000100:00100000:3.0:1788623132.205401:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866792704 00000100:00100000:3.0:1788623132.205419:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788623132.205426:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866792576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.205483:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866792576:12345-0@lo:400:kworker.0 Request processed in 57us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623132.205491:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788623132.205506:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788623132.205512:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866792704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.205551:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875506866792704:12345-0@lo:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623132.205558:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788623132.205586:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788623132.205591:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff997e2ecbc380, transno 8589934595 00000004:00080000:3.0:1788623132.205601:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788623132.205624:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866792704:0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.205636:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875506866792576:0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.206250:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e084a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866792960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623132.206286:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623132.206342:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866792960 00000100:00100000:3.0:1788623132.206346:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866792960 00000100:00100000:3.0:1788623132.206376:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788623132.206383:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866792960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788623132.206421:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788623132.206459:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875506866792960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623132.206465:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788623132.206500:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e084a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875506866792960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788623132.207047:0:15742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866792832 00000100:00100000:3.0:1788623132.207053:0:15742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866792832 00000100:00100000:3.0:1788623132.207089:0:15742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788623132.207096:0:15742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e03292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866792832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.207142:0:15742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e03292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875506866792832:12345-0@lo:400:kworker.0 Request processed in 46us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623132.207149:0:15742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788623132.207182:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875506866792832:0@lo:400:kworker.0 00000100:00080000:3.0:1788623132.207629:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788623132.207634:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788623132.208256:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3278:1875506866792448:0@lo:400:kworker.0 00000100:00100000:0.0:1788623132.208331:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788623132.208520:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866792448 00000100:00100000:3.0:1788623132.208539:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866792448 00000100:00100000:3.0:1788623132.208579:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788623132.208588:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3278:x1875506866792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788623132.208630:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd2d9f5a-a1d8-466a-ac20-a19462995af0+19:3278:x1875506866792448:12345-0@lo:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623132.208636:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788623132.208774:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd2d9f5a-a1d8-466a-ac20-a19462995af0:3278:1875506866792448:0@lo:400:kworker.0 00000100:00100000:2.0:1788623132.208913:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866793216:0@lo:400:kworker.0 00000100:00100000:2.0:1788623132.208944:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788623132.208966:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788623132.208972:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff997e065f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866793088:0@lo:400:kworker.0 00000100:00100000:0.0:1788623132.209092:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866793216 00000100:00100000:0.0:1788623132.209097:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866793216 00000100:00100000:0.0:1788623132.209133:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788623132.209141:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866793216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788623132.209180:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788623132.209256:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506866793088 00000100:00100000:1.0:1788623132.209261:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506866793088 00000100:00100000:1.0:1788623132.209304:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788623132.209318:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e065f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866793088:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788623132.209448:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788623132.209764:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875506866793216:12345-0@lo:400:kworker.0 Request processed in 622us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788623132.209771:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788623132.209879:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875506866793216:0@lo:400:kworker.0 00000100:00100000:2.0:1788623132.210088:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff997e065f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875506866793088:0@lo:400:kworker.0 00000100:00100000:1.0:1788623132.210136:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e065f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875506866793088:12345-0@lo:400:kworker.0 Request processed in 824us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623132.210143:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788623132.843914:0:15452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788623132.935718:0:16601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788623133.405290:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405329:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405369:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405388:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405410:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405428:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405463:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.19@tcp (source: 12345-192.168.204.19@tcp) 00000100:00100000:1.0:1788623133.405488:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424320 00000100:00100000:1.0:1788623133.405499:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424320 00000100:00100000:1.0:1788623133.405556:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424832 00000100:00100000:1.0:1788623133.405560:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424832 00000100:00100000:1.0:1788623133.405575:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424448 00000100:00100000:1.0:1788623133.405578:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424448 00000100:00100000:1.0:1788623133.405609:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424704 00000100:00100000:1.0:1788623133.405612:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424704 00000100:00100000:1.0:1788623133.405629:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:1.0:1788623133.405639:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2348:x1875506858424320:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623133.405708:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2348:x1875506858424320:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 71us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623133.405715:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 19 00000100:00100000:1.0:1788623133.405732:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:1.0:1788623133.405773:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2348:x1875506858424832:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623133.405802:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2348:x1875506858424832:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 63us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623133.405809:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 20 00000100:00100000:1.0:1788623133.405821:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788623133.405828:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2348:x1875506858424448:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623133.405851:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da67b507-6848-4965-872f-6899e670b6fc+5:2348:x1875506858424448:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623133.405857:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 21 00000100:00100000:1.0:1788623133.405867:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:1.0:1788623133.405873:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2348:x1875506858424704:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623133.405892:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7913ea46-1c5d-4f6e-a105-ceba586b48a3+5:2348:x1875506858424704:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 19us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623133.405897:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 22 00000100:00100000:1.0:1788623133.405913:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424576 00000100:00100000:1.0:1788623133.405917:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424576 00000100:00100000:1.0:1788623133.405952:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424192 00000100:00100000:1.0:1788623133.405956:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424192 00000100:00100000:1.0:1788623133.405993:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:1.0:1788623133.406000:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2348:x1875506858424576:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623133.406031:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7913ea46-1c5d-4f6e-a105-ceba586b48a3+6:2348:x1875506858424576:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 32us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623133.406038:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 30 00000100:00100000:1.0:1788623133.406050:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:1.0:1788623133.406057:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e084aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+20:2348:x1875506858424192:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:1.0:1788623133.406081:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e084aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da67b507-6848-4965-872f-6899e670b6fc+20:2348:x1875506858424192:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788623133.406086:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 31 00000100:00100000:3.0:1788623133.406892:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875506858424064 00000100:00100000:3.0:1788623133.406902:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875506858424064 00000100:00100000:3.0:1788623133.407003:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00100000:3.0:1788623133.407024:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff997e3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2348:x1875506858424064:12345-192.168.204.19@tcp:400:kworker.0 00000100:00100000:3.0:1788623133.407080:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff997e3cb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4a5d1e3-a8db-449a-a137-c2c20c345ee0+13:2348:x1875506858424064:12345-192.168.204.19@tcp:400:kworker.0 Request processed in 57us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788623133.407087:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.19@tcp, seq: 123 00000100:00080000:0.0:1788623133.411737:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788623133.411887:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788623133.411891:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788623133.868361:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29572 lines, 29572 kept, 0 dropped, 0 bad.